Makefile.gstlal_idq_icc: fix linking so that gstlal install is not skipped, fixed target for kafka-python install, updated version for kafka python bindings to use seek features, fixed issues with kafka install when Makefile is run multiple times, switched order of pulling of repos so that user is prompted immediately for credentials for idq git pull

gstlal_feature_extractor: added option for different types of formatting on data transfer of features, added a periodic queue flush so that queue does not fill up over time

gstlal_feature_extractor_pipe: changed segment splitting so that segments do not get shifted from segment_length arg given, added options in offline Makefile to request save and persist cadence, updated params to reflect more closely offline runs

gstlal_feature_extractor: changed use_kafka option to be part of save_format instead, to allow only one data transfer/saving option to run at a given time, fixed issue with hdf5 file saving where there were repeated timestamps, cleaned up finalization of saving features to disk when pipeline finishes, changed some default save/persist cadences

gstlal_feature_extractor: changed file saving to always persist features per persist_cadence rather than it being a feature for live data only. changed how features are pushed to kafka so that timestamps are aggregated correctly and depend on trigger time rather than buffer time

updated gstlal_feature_extractor + iDQ makefile with new gstlal opt build changes, added kafka proper as part of install, fixed some issues with C flags in kafka-python that caused install to fail

add gstlal_feature_extractor_pipe_online for online DAG submission, fixed issues with producing correct gps ranges for condor jobs in gstlal_feature_extractor_pipe

gstlal_feature_extractor: ensure that filenames of hdf5 files containing features have accurate gps range in their names by using the feature_start(end)_time options, if specified. changed named of trigger_start(end)_time from trigger -> feature. removed unnecessary typecasting for gps times

gstlal_feature_extractor + idq_utils.py: modified method of saving features as hdf5 so that max_snr option produces regularly sampled feature rows now

gstlal_feature_extractor: add dot graph for documentation, added separate groups for command line options, move imports around for aesthetics, change comment blocks (e.g. main) for documentation

This reverts commit 9ac1b181

gstlal_feature_extractor: propagated new waveform generation changes throughout, fixed some bugs/typos from switch causing pipeline to crash

gstlal_feature_extractor: fixed bug in determining trigger time from buffer rows, now based on filter duration

idq_utils.py: changed implementation for generating sampled points for sine-gaussian and half-sine-gaussian waveforms

gstlal_feature_extractor_template_overlap + idq_utils.py: fixed bug in template generation causing missing templates, changed way templates are produced as a result, propagated changes to template validation code

gstlal_feature_extractor_template_overlap: added template bank overlap plot, aesthetic changes to html report

gstlal_feature_extractor_template_overlap: tweaked some plot params, added sampling of waveforms to plot to limit the number of waveforms plotted

idq_utils.py: added HDF5SeriesFeatureData to dump unevenly sized datasets of features to disk, gstlal_feature_extractor: fixed a bug in reporting trigger time for sine gaussian waveforms, chaged scheme on how to retrieve rows from buffer

gstlal_feature_extractor + idq_multirate_datasource.py: stripped out cheb downsampler in favor of stock resampler, added nxydump_segment options to dump timeseries to disk, lowered default Qlow setting

gstlal_feature_extractor_template_overlap: added html report + waveform plots for template validation

gstlal_feature_extractor + related files: added sine-gaussian waveform and made option available to use as basis function for feature extraction

gstlal_feature_extractor_whitener_check: fixed issue with pipeline hanging after EOS, updated mkbasicmultisrc using new function args

Koh Ueno authored 6 years ago and Kipp Cannon committed 6 years ago

- adjust gstreamer plugin .so filenames on gstreamer 1.14+ to work
around changes to name mangling used by the plugin scanner

updated offline feature extractor Makefile to have configurable channel list as well as updated job parameters for submitting Condor jobs efficiently