Skip to content

Bug fixes for containers and file transfer

This MR has mixed up two classes of fixes I've needed to get review tests running in containers over the OSG and locally.

  • data files aren't being picked up correctly after file transfer, this is fixed by using the existing resolve_filename_with_transfer_fallback.
  • the container file isn't being transferred for many jobs as it is added to the transfer files after the transfer files are added to the extra lines.
  • submitting to the local condor pool from an OSG access point requires specifying MY.flock_local and MY.DESIRES_sites = "nogrid" so I've added these when self.inputs.osg is false. This has no impact when submitting from a local condor access point.
  • MY.flock_local can be used anywhere to access the local pool, e.g., match with CIT nodes when submitting from ldas-osg.ligo.caltech.edu. I've added this for all jobs not requesting specific sites.

I have tests running with this version of bilby_pipe at CIT:/home/colm.talbot/bilby-pipe-nightly-tests/latest-250219

Edited by Colm Talbot

Merge request reports

Loading