Run an IMBH search on O4 data. **First set of results need to be done by June 2024 for it to be in GWTC4.** # Final Runs for GWTC-4 - Singularity container: - https://git.ligo.org/gstlal/o4a-containers/-/tree/imbh_offline?ref_type=heads - CIT: /home/gstlalcbc.offline/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014 - ICDS: /ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014 - Gstlal branch: imbh_offline - Build directory: inside singularity container /src/gstlal/ ## Instructions for launching runs: 1. go to CIT:/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/ or similar directory on other clusters and make run directory with a name like chunk1_imbh_1368975618_1370097052 (chunk<#>_imbh_start_stop). Use chunk definitions as [here](https://wiki.ligo.org/CBC/Searches/O4Information). 2. cd chunk1_imbh_1368975618_1370097052 3. cp -r ../safe/* . 4. Please make sure min-instruments is set to 2 in the config in both places and the singularity image is correct. Change start and stop times and working directory name in config, start and stop times in data_inj.sh and ./data_frame/Makefile. Change the user account in `data_inj.sh` to your `albert.einstein` username (in line 5, `X509_USER_PROXY=xxxx`) 5. source env.sh 6. ./data_inj.sh makes the data and injection frames. On ICDS, run `source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh` and `conda activate igwn` before `./data_inj.sh`. 7. Change the name of the injection file in the config to the new injection xml created by last step. singularity exec image-name gstlal_inspiral_workflow init -c config.yml 8. Run singularity exec image-name make $workflow to generate the dag. 9. condor_submit_dag dag-name 10. We dont need to make or run the rank dag since we will have to rank over all the chunks combined. [general workflow](https://git.ligo.org/gstlal/offline-configuration/-/tree/offline_new-workflow) ## ROTA for min-intstrument=2 runs - Prathamesh, Debnandini, Divya, Gooderham, Victoria | Chunk | Status | Person | Cluster: Rundir | Build| | ------ | ------ | ------ | ------ | ------ | | 1 | injection filter complete | Debnandini | CIT:/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk1_imbh_1368975618_1370097052 | imbh_offline | | 2 | injection filter complete | Victoria | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk2_imbh_1370097052_1371306087` | imbh_offline | | 3 | Completed | Prathamesh | CIT:`/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk3_imbh_1371306087_1372546081` | imbh_offline | | 4 | injection-filter dag complete| Victoria | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk4_imbh_1372546081_1373711624` |imbh_offline | | 5 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk5_imbh_1373711624_1374936316` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 6 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk6_imbh_1374936316_1376144770` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 7 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk7_imbh_1376144770_1377355516` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 8 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅| Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk8_imbh_1377355516_1378565116` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 9 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk9_imbh_1378565116_1379774716` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 10 | completed | Prathamesh | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk10_imbh_1379774716_1380984316` | imbh_offline | | 11 | completed | Prathamesh | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk11_imbh_1380984316_1382195103` | imbh_offline | | 12 | completed | Prathamesh | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk12_imbh_1382195103_1383404656` | imbh_offline | | 13 | injection_filter completed | Debnandini | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk13_imbh_1383404656_1384588801` | imbh_offline | | 14 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk14_imbh_1384588801_1385822808` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 15 | psd ✅ svd ✅ filter ✅ injection-setup ✅ injection-filter ✅ | Divya | ICDS: `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/runs_final/chunk15_imbh_1385822808_1387206946` | `/ligo/home/ligo.org/gstlalcbc/observing/4/IMBH/a/build_final/gstlal-imbh_offline_05312014` | | 16 | psd dag running | Prathamesh | CIT: `/home/gstlalcbc.offline/observing/4/IMBH/a/runs_final/chunk16_imbh_1387206946_1389455118` | imbh_offline | ## Build status ** Make a note of the date the container was pulled on a specific cluster and if any changes were made to it** - gstlal-imbh_offline_05312014 on CIT and ICDS pulled on 05/31/2024. Build is a tagged version of offline_new-workflow. **UPDATED ON DEC 20** ## Template bank as an extension to the AllSky bank with chi cut at -0.7 - q: (1, 20) - m1: (203.19789, 543.31272) - m2: (10.260235, 254.5776) - s1z: (-0.68679687, 0.98669922) - s2z: (-0.68679687, 0.98669922) - chi: (-0.6867968700000001, 0.9866992200000001) - Number of templates: `14728 ` ### Template bank The IMBH bank is `/ligo/home/ligo.org/debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10_chicut`. It's also in `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK_Q20_CHICUT-0-2000000000.h5`. ### Template plots [link](https://ldas-jobs.gwave.ics.psu.edu/~shio.sakon/observing/4/dev/imbh/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10_chicut/) and [link](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10_chicut/bank_plots/).  ### Bank sim plots [link](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10_chicut/) ### Ringdown plot The ringdown frequency vs Mtotal plot for this bank is [here](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10_chicut/bank_plots/Mtot_Vs_fringdown_bank.png), the 10 Hz line is in red.  ## Template bank overlapping with the AllSky bank - q: 1-10 - m1: 50-500 - Number of templates: `23458` ### Template bank The IMBH bank is `/home/debnandini.mukherjee/IMBH/O4dev/fragmented_dag_runs/safe/H1L1V1-O4_MANIFOLD_m5032.xml`. It's also in `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK-0-2000000000.h5` and `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK-0-2000000000.xml.gz`. ### Template plots [link](https://ldas-jobs.gwave.ics.psu.edu/~shio.sakon/observing/4/dev/imbh/O1IMBHlike_nons_m5032_mm99/)  ## Template bank as an extension to the AllSky bank - q: 1-20 - m1: 200-500 - m2: 10-500 - Number of templates: `14817` ### Template bank The IMBH bank is `/ligo/home/ligo.org/debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10`. It's also in `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK_Q20-0-2000000000.h5` and `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK_Q20-0-2000000000.xml.gz`. ### Template plots [link](https://ldas-jobs.gwave.ics.psu.edu/~shio.sakon/observing/4/dev/imbh/O1IMBHlike_nons_m5032_mm99_m1above200/)  ### Ringdown plot The ringdown frequency vs Mtotal plot for this bank is [here](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10/bank_plots/Mtot_Vs_fringdown_bank.png), the 10 Hz line is in red.  The ringdown frequency vs Mtotal plot of the bank with chi>-0.7 is [here](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200_m2min10/bankcutchi0_7/Mtot_Vs_fringdown_bank.png). It does seem the templates stay higher up above the f=10 Hz line. Difference in the number of templates is ~ 2000.  ## Template bank as an extension to the AllSky bank (old, m2 not going down to full q20) - q: 1-20 - m1: 200-500 - Number of templates: `7708` ### Template bank The IMBH bank is `/ligo/home/ligo.org/debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200`. It's also in `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK_Q20_OLD-0-2000000000.h5` and `/home/shio.sakon/observing/4/dev/banksim/bank/H1L1V1-O4_MANIFOLD_IMBHBANK_Q20_OLD-0-2000000000.xml.gz`. ### Template plots [link](https://ldas-jobs.gwave.ics.psu.edu/~shio.sakon/observing/4/dev/imbh/O1IMBHlike_nons_m5032_mm99_m1above200/) ### Ringdown plot The ringdown plot for m1>200 bank is [here](https://ldas-jobs.gwave.ics.psu.edu/~debnandini.mukherjee/IMBH_O4_dev/manifold/bank/O1IMBHlike_nons_m5032_mm99_m1above200/bank_plots/Mtot_Vs_fringdown_bank.png), the red line indicates 10Hz, it seems for this bank, the templates are above it (I remember making plots of this type using injections before, they didn't go below 10Hz until around 700 solar mass in Mtotal)