add gstlal_feature_extractor_pipe_online for online DAG submission, fixed issues with producing correct gps ranges for condor jobs in gstlal_feature_extractor_pipe

gstlal_feature_extractor: ensure that filenames of hdf5 files containing features have accurate gps range in their names by using the feature_start(end)_time options, if specified. changed named of trigger_start(end)_time from trigger -> feature. removed unnecessary typecasting for gps times

gstlal_feature_extractor + idq_utils.py: modified method of saving features as hdf5 so that max_snr option produces regularly sampled feature rows now

gstlal_feature_extractor: add dot graph for documentation, added separate groups for command line options, move imports around for aesthetics, change comment blocks (e.g. main) for documentation

This reverts commit 9ac1b181

gstlal_feature_extractor: propagated new waveform generation changes throughout, fixed some bugs/typos from switch causing pipeline to crash

gstlal_feature_extractor: fixed bug in determining trigger time from buffer rows, now based on filter duration

idq_utils.py: changed implementation for generating sampled points for sine-gaussian and half-sine-gaussian waveforms

gstlal_feature_extractor_template_overlap + idq_utils.py: fixed bug in template generation causing missing templates, changed way templates are produced as a result, propagated changes to template validation code

gstlal_feature_extractor_template_overlap: added template bank overlap plot, aesthetic changes to html report

gstlal_feature_extractor_template_overlap: tweaked some plot params, added sampling of waveforms to plot to limit the number of waveforms plotted

idq_utils.py: added HDF5SeriesFeatureData to dump unevenly sized datasets of features to disk, gstlal_feature_extractor: fixed a bug in reporting trigger time for sine gaussian waveforms, chaged scheme on how to retrieve rows from buffer

gstlal_feature_extractor + idq_multirate_datasource.py: stripped out cheb downsampler in favor of stock resampler, added nxydump_segment options to dump timeseries to disk, lowered default Qlow setting

gstlal_feature_extractor_template_overlap: added html report + waveform plots for template validation

gstlal_feature_extractor + related files: added sine-gaussian waveform and made option available to use as basis function for feature extraction

gstlal_feature_extractor_whitener_check: fixed issue with pipeline hanging after EOS, updated mkbasicmultisrc using new function args

Koh Ueno authored 6 years ago and Kipp Cannon committed 6 years ago

- adjust gstreamer plugin .so filenames on gstreamer 1.14+ to work
around changes to name mangling used by the plugin scanner

updated offline feature extractor Makefile to have configurable channel list as well as updated job parameters for submitting Condor jobs efficiently

multichannel_datasource.py: added option to force splitting of channels into subsets with an equal number of channels for serial processing

multichannel_datasource.py: added a 4s max buffer duration reblock element after demux when reading in frames to reduce memory footprint substantially

gstlal_feature_extractor: fixed issue where triggers were not being saved caused by a typo in save_format option, added message when triggers were persisted to disk on final write

gstlal_feature_extractor: removed check in DataSourceInfo causing the pipeline to not start up using live data, added an option for live data that allows features to be persisted to disk at a regular cadence, minor refactoring in MultiChannelHandler

gstlal_feature_extractor_pipe + offline Makefile: added request_disk feature to condor submissions to ensure there is enough local space to run jobs

multichannel_datasource.py: fixed bug introduced with change mkbasicmultisrc where conditional that checks if frame segments are set was flipped. This caused the pipeline to crash when not passing in segment lists

gstlal_feature_extractor_pipe: fixed bug where jobs were created for time stretches in which there was no analyzable time