Skip to content

Hack for nessai with file transfers

Michael Williams requested to merge michael.williams/bilby_pipe:nessai-transfer-files into master

As described in this issue: https://git.ligo.org/computing/helpdesk/-/issues/3260, checkpointing with nessai is not working with transfers file because of how preserve_relative_paths seems to

Given the timelines for O4 review, this is a temporary solution to that problem that will work in most cases but will fail with some settings. Specifically, if extra plots are enabled in nessai. These settings are generally not used since they can create hundreds of plots, so I would not anticipate using them in practice. In the odd case where they were necessary, an analysis could be run without file transfers.

Here is a run where I called condor_vacate_job and the job successfully resumed: https://ldas-jobs.ligo.caltech.edu/~michael.williams/bilby-dev/bilby-pipe/resume-issue-498/outdir_w_tf_vacate_C/

This should 100% be reverted once we have a better solution.

Merge request reports