CI development

This MR will include many useful unit tests in the continuous integration. This long overdue upgrade will save a lot of manual effort in making plots for reviews, reduce the occurrence of bugs in the code, and make bugs easier to catch right away. Here are the tests that are now included:

• Run 3 versions of the calibration pipeline, and check that the right number of calibrated frames are produced
• Check the ASDs of GDS-CALIB_STRAIN and GDS-CALIB_STRAIN_CLEAN, and compare them to a "standard", nominally correct ASD. Plots are included in the CI job artifacts.
• Check the TDCFs, and compare them to nominally correct TDCFs. Plots included.
• Check the calibration state vector, and compare each bit to a nominally correct state vector. Plots included.
• Measure ratios of h(t) / Pcal and h(t) / Actuation injections, and compare to a nominally correct version. Time-series plots included.
• Use FrDiff to compare GDS-CALIB_STRAIN_CLEAN in frames produced by two otherwise identical pipelines with different start times. They are required to be identical.
• Measure the latency in a simulated low-latency-like configuration. Check that the mean latency is not too large, that there are not frequent or large excursions, and that the latency does not increase steadily with time.

Job artifacts from the most recent commit (at the time of writing) can be seen here, including plots and txt files with the data being plotted.

Getting all stages of the CI to work also required me to address some packaging issues. If I did things correctly, this MR Closes #7 (closed), #12 (closed), #14 (closed), #15 (closed), #26 (closed). I was not able to add @duncanmmacleod as a reviewer, but he created several of these issues.

gstlal-calibration.spec.in

@@ -141,27 +141,31 @@ rm -Rf ${RPM_BUILD_DIR}/%{name}-%{version}
 
 
 %changelog
-Thu 18 Jul 2024 Madeline Wade <madeline.wade@ligo.org> - 1.5.7-1
--Fix oversubtraction
+* Thu 18 Jul 2024 Madeline Wade <madeline.wade@ligo.org> - 1.5.7-1
+- Fix oversubtraction
 - Modified output channels that report information about configs
 - Fix for a line subtraction gating bug
 - Fix for a line subtraction failure
 - Print config, filters, and version info on startup
 - Significantly reduced pipeline startup time
 - No more warning messages, etc., at pipeline startup
-Mon 10 Jun 2024 Aaron Viets <aaron.viets@ligo.org> - 1.5.6-1
+
+* Mon 10 Jun 2024 Aaron Viets <aaron.viets@ligo.org> - 1.5.6-1
 - Print config, filters, and version info on startup
 - New option --version
-Thu 06 Jun 2024 Aaron Viets <aaron.viets@ligo.org> - 1.5.5-1
+
+* Thu 06 Jun 2024 Aaron Viets <aaron.viets@ligo.org> - 1.5.5-1
 - Mitigation of oversubtraction of spectral lines
 - Improved channels with filters, config, and version info
 - Fix for line subtraction gating bug caused by typecasting error
 - Improved handling of missing input data for line subtraction
 - A few basic unit tests
-Wed 29 Nov 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.4-1
+
+* Wed 29 Nov 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.4-1
 - Replace nans with zeros in the subtracted NOLINES signal
 - Debian packaging fix
-Wed 22 Nov 2023 Aaron Viets <aaron.viets@ligo.org> - 1.5.3-1
+
+* Wed 22 Nov 2023 Aaron Viets <aaron.viets@ligo.org> - 1.5.3-1
 - Ability to report configuration and filters info in the frames
 - Require timestamp syncing of filter updates for reproducibility
 - New EPICS naming scheme with variable names rather than numbers
@@ -172,16 +176,21 @@ Wed 22 Nov 2023 Aaron Viets <aaron.viets@ligo.org> - 1.5.3-1
 - Option to use a threshold or channel to start filter clock
 - Gate noise subtraction TFs with amplitude channels
 - Filters ok bit fix
-Mon 17 Apr 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.2-1
+
+* Mon 17 Apr 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.2-1
 - Bug fix for line subtraction
-Thu 23 Mar 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.1-1
+
+* Thu 23 Mar 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.1-1
 - Compatability fixes for pyGobject
-Wed 22 Mar 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.0-1
+
+* Wed 22 Mar 2023 Madeline Wade <madeline.wade@ligo.org> - 1.5.0-1
 - Updates to calibration state vector
 - Ability to apply nonsens cleaning channel
 - Compatability fixes for pyGobject
 - Fix for integer string conversion error
-Wed 16 Nov 2022 Madeline Wade <madeline.wade@ligo.org> - 1.4.0-1
+
+* Wed 16 Nov 2022 Madeline Wade <madeline.wade@ligo.org> - 1.4.0-1
 - Additional of gstlal_correct_strain pipeline
 - Functionality for uncertainty estimation
 - Processing functions for swept sine measurements
+