Script for downloading events info from CBCFlow (path loaded on CIT), skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` Raw data on CIT is in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_events_data`
Script for downloading events info from CBCFlow (path loaded on CIT), skymaps(.fits) from GraceDB and strain data from LIGO servers using GWpy. Note: needs valid ligo key path for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` Raw data on CIT is in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_events_data`
| [final_results_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/final_results_plots.ipynb) | Plot of rejected and selected pairs | needs PWT approval | | \-------------- | |
| [Lensing paper plot](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_O4a.pdf) | Plot of rejected and selected pairs | needs PWT approval | The legend of the x axis is cut. | \-------------- | |
| [final_results_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/final_results_plots.ipynb) | Plot of rejected and selected pairs | needs PWT approval | | \-------------- | :heavy_check_mark: |
| [Lensing paper plot](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_O4a.pdf) | Plot of rejected and selected pairs | needs PWT approval | The legend of the x axis is cut. Also it would be good to use different symbols for points which are kept and points which are not. | \-------------- | |
# Review Calls
The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: https://shorturl.at/uxLS5
The review call happens on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: https://shorturl.at/uxLS5
## 13 July 2023
* We discussed the plan and action items for finalising the machine for production run.
* We discussed the plan and action items for finalising the machine for the production run.
- PSD for training and testing.
- Population: astro (haris et al 1400+1400) , astro (O4) v/s uniform (8000+8000) v/s ensembling
- training set size, Overfitting and optimization, variance.
...
...
@@ -173,12 +173,12 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h
* We discussed the 2 v/s 3 detector events ROCs using skymaps
* We saw the PSDs, it seems O4a real and projected noise is compatible except for the lower frequency (\<70 Hz). The two LIGOs are working close to the design sensitivity as well.
* We went through the first set of preliminary results of lensid for O4a events.
* We went through the first set of preliminary results of Lensid for O4a events.
* We also discussed lensingflow integration and the possibility of Asimov.
### Action items
* [x] Make lensid compatible with a single pair, with the config file.
* [x] Make Lensid compatible with a single pair, with the config file.
* [x] FAP computation implemented
## 10 October 2023
...
...
@@ -194,8 +194,8 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h
## 8 November 2023
* We discussed the integration of lensid with the lensing flow and visited the new package: https://git.ligo.org/srashti.goyal/alensidforlensingflow
* JR suggested to use O4a real noise PSDs for the training and testing of the final ML model for the production runs. (detchar)\[https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary\\\\\\]
* We discussed the integration of lensid with the lensing flow and visited the new package: https://git.ligo.org/srashti.goyal/alensidforlensingflow
* JR suggested to use O4a real noise PSDs for the training and testing of the final ML model for the production runs. (detchar)\[https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary\\\\\\\]
* We are still unsure about the inclusion of the population and the time delay lensing priors for the follow-up strategy.
## Action items
...
...
@@ -269,8 +269,8 @@ We also want to prepare a document to quantify all the things. One main issue is
## 14 June 2024
* We eyeballed events with zero mass overlaps but selected by lensID.
* Saurabh reviewed some of the scripts and discussed conceptual things regarding bhattacharya distance.
* We also discussed the findings of Adrien and also SAurabh that GWPy QTs are better than PYCBC ones and that seems to be one of reasons for improvement for SLICK.
* Saurabh reviewed some of the scripts and discussed conceptual things regarding Bhattacharya distance.
* We also discussed the findings of Adrien and also Saurabh that GWPy QTs are better than PYCBC ones, and that seems to be one of reasons for improvement for SLICK.
