Skip to content

Dataviewer fails to display more than one trace at a time

In one of our cymac setups, dataviewer fails if more than one trace is selected from the list (e.g. with all settings set at defaults). In the following logs, bacardi is the cymac, peapsy is the workstation on which command LIGONDSIP=bacardi dataviewer is executed.

Having started dataviewer, I selected two channels (B1:IOP-ADC30_FILTER_EXC and B1:IOP-ADC31_FILTER_EXC) from the list and tried to plot them with the default settings. This did not work as expected: a plotter window did appear, but nothing was shown in it.

Output of `dataviewer` in the terminal (Click to expand/fold) 

Connecting.... done
Warning: Not all children have same parent in XtManageChildren
Warning: Not all children have same parent in XtManageChildren
Warning: Not all children have same parent in XtManageChildren
Warning: Not all children have same parent in XtManageChildren
Warning: Not all children have same parent in XtManageChildren
Connecting.... done
Connecting.... done
Server error 13: no data found
datasrv: DataWriteRealtime failed: daq_send: Resource temporarily unavailable
System journal on `bacardi` for the same period of time. 

Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ->3: version
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ->3: revision
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ->3: status channels 3
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] no_average=0
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] About to request `B1:IOP-ADC30_FILTER_EXC' 1 on node 42
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] About to request `B1:IOP-ADC31_FILTER_EXC' 2 on node 42
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] Requesting 2 testpoints; tp[0]=1; tp[1]=2
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:17 bacardi daqd[21810]: [Mon Mar  7 22:31:17 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:18 bacardi daqd[21810]: [Mon Mar  7 22:31:18 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:19 bacardi daqd[21810]: [Mon Mar  7 22:31:19 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] dcu 42 test point 1 at index 0
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ifo 0 DCU 42 tp 1
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ETIMEDOUT: test point `B1:IOP-ADC31_FILTER_EXC' (tp_num=2) was not set by the test point manager; request failed
Mar 07 22:31:20 bacardi daqd[21810]: [Mon Mar  7 22:31:20 2022] ->3: start net-writer "7000" { "B1:IOP-ADC30_FILTER_EXC" 128 "B1:IOP-ADC31_FILTER_EXC" 128 }

So daqd throws error ETIMEDOUT: test point `B1:IOP-ADC31_FILTER_EXC' (tp_num=2) was not set by the test point manager; request failed.

There is no such error if I request only B1:IOP-ADC31_FILTER_EXC (or only B1:IOP-ADC30_FILTER_EXC).

If I select a different pair of testpoints, or if I request more than two testpoints, the error also appears.

We noticed this error started to appear immediately after upgrading the Debian RCG packages from v. 4.1.0 to v. 4.2.7.

We have another cymac which still runs advligorts packages of v. 4.1.0. I tried connecting to it from the same workstation, peapsy, and did not get this error. So, potentially something broke in between these versions, or, more likely, we just screwed up something during the upgrade.

There is nothing suspicious in the system logs apart from that error; all rts-* systemd services are working fine, everything on GDS_TP screens is green. Restarting various services and/or models did not fix the problem.