rewhiten updates
A couple small fixes:
- Jacob's profile was an icds one, but now that we make all svds on cit, I switched that to ldas
- Added the
Makefile.update_filesto the Dockerfile so we can copy it from the container
Larger change:
- I propose we change the directory structure of rewhitening to:
/home/gstlalcbc.offline/observing/4/a/rewhiten/{GSP-START}-{DUR}/<ANALYSIS>- I think this will make it easier so that we don't have to update so many things manually in the Makefile.update_files every week (currently you ahve to input the gps start, stop, and edit the date string in all the rewhitening paths). With this structure you only have to input the gps start time
- I also think this will make automatic file finding easier in the future. ie, we usually work with GPS times rather than dates so if we're running some offline analysis in the future, I think it'll be easier to find the SVDs we need by gps time than date.
- Changed jacob's rsync target so that we copy files from CIT to ICDS first to a tmp dir since this stage takes longer, that way we can keep the DAG running while the rsync goes on. When it finishes, we can rm the current svd files and do the faster mv operation from the tmp dir to the run dir.