inspiral.py: support offline gracedb mode where a file:// url causes the output to be written to disk

inspiral.py: Enforce that appended zeros in subthreshold trigger generation have same dtype as snr time series

"*1_snr", matching what was done pre-itacac

inspiral.py: Create sub-threshold trigger to add to gracedb uploads if
we have snr from an instrument that didn't produce a trigger above peak
coincident with the candidate in question. Also, only upload one snr
time series per trigger (including the sub-threshold trigger), not an
snr time series for each ifo for each trigger. After this patch, gracedb
uploads should look almost identical to what they were before switching
to itacac

All of the changes necessary to build and run itacac instead of itac. Note that itac will no longer work after this commit

- fix process_id column name in sngl_inspiral table

- sngl_inspiral's process column is "process:process_id"

- this patch adds a translator to convert gracedb event uploads from
  integer ID format to the legacy ilwd:char ID format.  it can be reverted
  if gracedb is updated to accept integer ID format files

- gstlal-calibration is not touched

chad.hanna authored 6 years ago and Kipp Cannon committed 6 years ago

inspiral.py: under max over coinc in gracedb upload since clustering has been added post coincidence

inspiral.py: choose only the best coinc for gracedb uploads, and fix performance issue of generating an xml doc when there are no uploads to do

- move Handler to its own module
- rename .gen_psd_xmldoc() to .__get_psd_xmldoc() following conventions used in inspiral.Data
- inspiral.py: excise gracedb code from Data object, encapsulate in GracedBWrapper class
- remove now unused write_psd_fileobj() from reference_psd.py
- move Data class to lloidhandler.py
- rename ._gatehandler() .__gatehandler() for consistency
- remove .flush(), unused locking wrapper of .__flush()
- remove .do_gracedb_alerts(), unused locking wrapper of .__do_gracedb_alerts()
- excise eye candy from Data class, move to stand-alone EyeCandy class
- merge what remains of Data and Handler into a single class
- excise segment tracking from result, move to stand-alone SegmentsTracker class
- use Handler's PSDs for GracedB uploads instead of getting new ones
  (addresses a FIXME)

- can rely on gracedb module import to work

- template bank files are .xml.gz files

infrastructure

- disable ln L assignment online until ranking statistic is sufficiently-well measured.  this is just a first hack to be better than nothing for the KAGRA testing being done.  it will surely be replaced by something else, later.

- for some reason inspiral.py has it's own, unmaintained, versions of command line parsing stuff that's in datasource.py.  I don't know what's going on, but the way it is doesn't work with KAGRA and I think this patch fixes it

- initial attempt to automatically disable FAP/FAR assignment until enough statistics have been collected to make it possible

- fixes "... has no attribute .coincs_document" crashes
- addresses some lingering FIXMEs and removes some cruft

- don't need to convert URLs to local filenames to use, that's what that function is for

- dump is a URL is set, not necessarily just because the data is there to dump

- .T050017_filename() moved homes and I forgot to update where the instruments come from

- fixes a bug in the filename construction code in the snapshot path
- uses CacheEntry to parse T050017 filenames instead of doing it by hand
- fixes a typo in a comment