Update Result Review O4a authored by Jean-Rene Cudell's avatar Jean-Rene Cudell
...@@ -54,7 +54,7 @@ O4a Data preparation scripts: ...@@ -54,7 +54,7 @@ O4a Data preparation scripts:
</td> </td>
<td> <td>
Script for downloading events info from CBCFlow (path loaded on CIT), skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` Raw data on CIT is in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_events_data` Script for downloading events info from CBCFlow (path loaded on CIT), skymaps(.fits) from GraceDB and strain data from LIGO servers using GWpy. Note: needs valid ligo key path for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` Raw data on CIT is in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_events_data`
</td> </td>
<td>Reviewed</td> <td>Reviewed</td>
<td></td> <td></td>
...@@ -118,16 +118,16 @@ Publication results: ...@@ -118,16 +118,16 @@ Publication results:
|---------|-------------------|--------|---------|----------|----------| |---------|-------------------|--------|---------|----------|----------|
| [Final Results](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_results_5May25.csv) | O4a Pairs analysed by LensID | Done | | b3a5135e0f03ad7587e53b2814feb2de10b94507 | | | [Final Results](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_results_5May25.csv) | O4a Pairs analysed by LensID | Done | | b3a5135e0f03ad7587e53b2814feb2de10b94507 | |
| [Interesting Pairs](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/interesting_pairs_5May25.csv?ref_type=heads) | Pairs passed for follow-up analysis | Done | | d20a4c29ffa623e771d664709747a57bb68ae5ce | | | [Interesting Pairs](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/interesting_pairs_5May25.csv?ref_type=heads) | Pairs passed for follow-up analysis | Done | | d20a4c29ffa623e771d664709747a57bb68ae5ce | |
| [final_results_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/final_results_plots.ipynb) | Plot of rejected and selected pairs | needs PWT approval | | \-------------- | | | [final_results_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/final_results_plots.ipynb) | Plot of rejected and selected pairs | needs PWT approval | | \-------------- | :heavy_check_mark: |
| [Lensing paper plot](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_O4a.pdf) | Plot of rejected and selected pairs | needs PWT approval | The legend of the x axis is cut. | \-------------- | | | [Lensing paper plot](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/LensID_O4a.pdf) | Plot of rejected and selected pairs | needs PWT approval | The legend of the x axis is cut. Also it would be good to use different symbols for points which are kept and points which are not. | \-------------- | |
# Review Calls # Review Calls
The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: https://shorturl.at/uxLS5 The review call happens on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: https://shorturl.at/uxLS5
## 13 July 2023 ## 13 July 2023
* We discussed the plan and action items for finalising the machine for production run. * We discussed the plan and action items for finalising the machine for the production run.
- PSD for training and testing. - PSD for training and testing.
- Population: astro (haris et al 1400+1400) , astro (O4) v/s uniform (8000+8000) v/s ensembling - Population: astro (haris et al 1400+1400) , astro (O4) v/s uniform (8000+8000) v/s ensembling
- training set size, Overfitting and optimization, variance. - training set size, Overfitting and optimization, variance.
...@@ -173,12 +173,12 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h ...@@ -173,12 +173,12 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h
* We discussed the 2 v/s 3 detector events ROCs using skymaps * We discussed the 2 v/s 3 detector events ROCs using skymaps
* We saw the PSDs, it seems O4a real and projected noise is compatible except for the lower frequency (\<70 Hz). The two LIGOs are working close to the design sensitivity as well. * We saw the PSDs, it seems O4a real and projected noise is compatible except for the lower frequency (\<70 Hz). The two LIGOs are working close to the design sensitivity as well.
* We went through the first set of preliminary results of lensid for O4a events. * We went through the first set of preliminary results of Lensid for O4a events.
* We also discussed lensingflow integration and the possibility of Asimov. * We also discussed lensingflow integration and the possibility of Asimov.
### Action items ### Action items
* [x] Make lensid compatible with a single pair, with the config file. * [x] Make Lensid compatible with a single pair, with the config file.
* [x] FAP computation implemented * [x] FAP computation implemented
## 10 October 2023 ## 10 October 2023
...@@ -195,7 +195,7 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h ...@@ -195,7 +195,7 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h
## 8 November 2023 ## 8 November 2023
* We discussed the integration of lensid with the lensing flow and visited the new package: https://git.ligo.org/srashti.goyal/alensidforlensingflow * We discussed the integration of lensid with the lensing flow and visited the new package: https://git.ligo.org/srashti.goyal/alensidforlensingflow
* JR suggested to use O4a real noise PSDs for the training and testing of the final ML model for the production runs. (detchar)\[https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary\\\\\\] * JR suggested to use O4a real noise PSDs for the training and testing of the final ML model for the production runs. (detchar)\[https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary\\\\\\\]
* We are still unsure about the inclusion of the population and the time delay lensing priors for the follow-up strategy. * We are still unsure about the inclusion of the population and the time delay lensing priors for the follow-up strategy.
## Action items ## Action items
...@@ -269,8 +269,8 @@ We also want to prepare a document to quantify all the things. One main issue is ...@@ -269,8 +269,8 @@ We also want to prepare a document to quantify all the things. One main issue is
## 14 June 2024 ## 14 June 2024
* We eyeballed events with zero mass overlaps but selected by lensID. * We eyeballed events with zero mass overlaps but selected by lensID.
* Saurabh reviewed some of the scripts and discussed conceptual things regarding bhattacharya distance. * Saurabh reviewed some of the scripts and discussed conceptual things regarding Bhattacharya distance.
* We also discussed the findings of Adrien and also SAurabh that GWPy QTs are better than PYCBC ones and that seems to be one of reasons for improvement for SLICK. * We also discussed the findings of Adrien and also Saurabh that GWPy QTs are better than PYCBC ones, and that seems to be one of reasons for improvement for SLICK.
### Action items ### Action items
... ...
......