Add support for scitokens authentication for data analysis jobs
Now that waveform data from lalsuite-extra are available through CVMFS, it would be great if these could be used with bilby_pipe. To access these files, authentication via scitokens is required (see this presentation). Currently, the data analysis jobs from bilby_pipe do not transfer the relevant token.
I believe the only changes necessary in the condor submit file are to add the line
use_oauth_services = igwn
and the environment line in the condor submit file needs to contain
BEARER_TOKEN_FILE=$$(CondorScratchDir)/.condor_creds/igwn.use
This second one can already be handled by the environment-variables
in the ini-file, so the only change in bilby_pipe needed is to add the first line to the condor submit files of data analysis jobs.
I am aware that data transfer could be used to transfer these files when running on the OSG, but we believe it is better to not have to transfer files of a few GBs for every job, which would be a heavy network load when starting a bunch of analyses at the same time. Accessing the files through CVMFS directly on the execute machine would instead make smarter use of caching of the files and reduce the network traffic. (Please correct me if I have understood wrong how file transfer works and it is not doing something so naively that it leads to heavy network traffic.)