This adds code to the shmem receiver to have it signal when it has taken 2s to look for new data.

This is meant to be a simple flag to show when the producer is 'stuck' waiting for data.

These are utility scripts used when running the daqd.

checkdaqconfig - freezes the config, archiving it by time & contents
daq_wiper - this deletes old frames to keep disks from filling on a frame writer

The stopping_now_ flag should be set to true to signal trender threads to stop.

Also move some stack based variable sized arrays onto the heap in std::vectors to remove a place that the stack can be overflowed.

Added a test to ensure the daqd stops when there is a jump in the data, and updated the live test daqdrc to start the trender thread to highlight issues with stopping.

This is done as part of expanding the wrapping of the pthread... calls with C++.  Starting on a interface to better track threads.

This will detect a missing libfl-dev package on Debian.  Find it at configure time, not build time.

The zmq streamers where kept around as a off the shelf method to move data for small (test) systems.  However the pub/sub code appears to work better, and has no distribution limitations either.  So remove the zmq code in favor of the pub/sub.

This is to help properly track lifetimes of the work queues.

Put in a wrapper around pthread_create to allow specifying an arbitrary job to run in the guise of a std::function.  This keeps the flexibility (scheduler, stack size, ...) of pthreads but gives the us the ability to call more than just a void* (*)(void*).

With these changes the work queues have been moved out of object scope for both the producer and the daqd objects.  A few small static routines that were used to start worker threads in the producer/daqd are removed.

Broke the code out into its own header for easier testing.  Updated the code to allow catching up if it falls behind, not just jumping to the front if there is a data gap.

Add the crc checks to the ctest batch of tests.

The checksum_crc object needs to have the add method called to import data.
The recv time was being written to the recv time pv and the full cycle time pv.
Updated a checksum test to make sure the new and old code produce the same checksum.

This addresses the issue by expanding the size of the bitmask.
* Replace the 'int' bitmask with a generic structure.  This allows the
type system to help us find all the places it is used.
* Replace direct bitmask manipulation with member functions to increase
local readability.
* Allow the new bitmask structure to have an increased capacity that can
be set (at compile time).
* Add unit tests to new bitmask code.
* Add test code to look at nds1 load.

Use transport-independent RPC package (tirpc) if available,
otherwise use RPC headers if still available.
Mostly for non-Debian compiles, as Debian asserts non-default
flag in glibc to retain the old RPC support

external dcu model.

* Removing makefile/autotools build pieces.
* Removing non-daqd_shmem specific files
* Removed some of the #ifdef soup

Turned src/drv/param.c src/drv/crc.c into a helper library.
Modified daqd and standalone_edc to consume this as a library.

Removed more now unused code from standalone_edc.

Tests:
 * daqd
 * nds

The test is to:

* start a simulated IFO (via fe_multi_stream_test)
* start daqd
* read live data from nds
* verify the data

This updates the NDS2 client detection, reimplements fe_stream_check_nds,
and adds some test harness logic.

Updated the FindEPICSBase.cmake to make full targets for ca, cas, Com, gdd.

This brings in:
* Updates to the cmake build to support FrameCPP 2.6+
* Various startup scripts for Debian8 & Gentoo 3.0
* Daqd files updated to match branch 3.5
* Moved over the ix/zmq/mx stream work from 3.5
* The split of daq_core.h into daq_core.h & daq_core_defs.h to
centralize declarations.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4827 6dcd42c9-f523-4c6d-aada-af552506706e

daqd_shmem used to be protected by a 'DEV_BUILD' option, build it all
the time, if you can.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4763 6dcd42c9-f523-4c6d-aada-af552506706e

When run on gcc 4.4 the zmq_recv process would segfault on the
construction of the zmq receiving object.  This is a rewrite of that
code back to C in hopes that that cleared up an issue specific to gcc 4.4.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4685 6dcd42c9-f523-4c6d-aada-af552506706e

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4657 6dcd42c9-f523-4c6d-aada-af552506706e

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4656 6dcd42c9-f523-4c6d-aada-af552506706e

A number of structures have common portions, extract the common header fields.

Fixed a spurious copy/paste error in comm_impl.cc.

Moved the zmq_recv from using a max number of dcus to using a max transmission size.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4653 6dcd42c9-f523-4c6d-aada-af552506706e

Combined the data/gds structures into one.  Updated the logic to allow
moving data from the fe simulation through to the daqd.  Partial work
on the daqd_shmem system (not complete).

Pulled some logic out of comm.y and placed it in its own files
comm_impl.cc/hh, to aid in debugging/tool introspection.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4651 6dcd42c9-f523-4c6d-aada-af552506706e

daqd_shmem is similar to a standiop.  However it reads data from one combined shared memory segment, does not require a timer or adc card.

Updates to the fe_stream_test to put data in the proper places.

Additional test scripts and commands to help manipulate and introspect mbuf memory buffers.
src/drv/mbuf/mbuf_probe
src/zmq_stream/scripts/dump_zmq_core_structs.py

Added a zmq_recv command to receive data from a zmq stream and publish it to a local mbuf.

Adding a new c userspace interface to the mbuf shared memory.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4650 6dcd42c9-f523-4c6d-aada-af552506706e

The rcv build of daqd had code to read cycle count information from an
array of rmIpcStr structures.

1. This was unneeded in this build of daqd
2. The array was never initialized and resulted in invalid pointers
3. It only ran in production due to optimization recognizing a unused variable and removing the bad read.

This code breaks the producer.cc out to producer_rcv.cc and removes the unneeded rmIpcStr structures and accesses.


git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4593 6dcd42c9-f523-4c6d-aada-af552506706e

Needed to split the zmq_daq.h file into two portions to avoid name conflicts on channel_t structures.  The daqd does not need (cannot use) the version found in the zmq_daq.h.
So zmq_daq_core.h contains the structures and definitions that the daqd needs to injest streams from the FE computers.
zmq_daq.h includes zmq_daq_core.h.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4469 6dcd42c9-f523-4c6d-aada-af552506706e

Improving the C++11 detection/selection for old cmake & gcc

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4468 6dcd42c9-f523-4c6d-aada-af552506706e

To enable you must pass -DDEV_BUILD=1 to cmake.


git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4451 6dcd42c9-f523-4c6d-aada-af552506706e

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4444 6dcd42c9-f523-4c6d-aada-af552506706e

Defaults to /usr/local/...  use -DCMAKE_INSTALL_PREFIX=... to set a different prefix.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4438 6dcd42c9-f523-4c6d-aada-af552506706e

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4435 6dcd42c9-f523-4c6d-aada-af552506706e

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4414 6dcd42c9-f523-4c6d-aada-af552506706e

The producer has been split out for zmq, but still does mx.  CMake
changes to help with builds of multiple daqds.

git-svn-id: https://redoubt.ligo-wa.caltech.edu/svn/advLigoRTS/trunk@4409 6dcd42c9-f523-4c6d-aada-af552506706e