Skip to content

Changes

Page history
Update Result Review O3b lensing authored by Jean-Rene Cudell's avatar Jean-Rene Cudell
Show whitespace changes
Inline Side-by-side
Result-Review-O3b-lensing.md
View page @ a34f7692
...@@ -42,7 +42,7 @@ Git hash: 09e01c8972074ee4f44120afb9095ea76c458c9f ...@@ -42,7 +42,7 @@ Git hash: 09e01c8972074ee4f44120afb9095ea76c458c9f
## Scripts/Configs ## Scripts/Configs
| Script | Short description | Status | git hash | Comment | final sign-off | | Script | Short description | Status | git hash | Comment | final sign-off |
|--------|-------------------|--------|----------|---------|----------------| |--------|-------------------|--------|----------|---------|----------------|
| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\*` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | ------- | JRC------------ | | [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | ------- | JRC------------ |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --- | -JRC------------- | | [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --- | -JRC------------- |
| [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py), [config_O3_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/config_O3_events.yaml) | Script for computing ML predictions for a given event pairs in dataframe, their skymaps, Qtransforms and the trained ML models. Optionally computes the False Positive Probabilities given the background. It requires config file as input. Eg: `lensid_make_predictions -config /home/srashti.goyal/lensid-ml-O3/config_O3_events.yaml` Note: change `odir` in **config** file. | JR: OK | ---------- | DC: Should be considered in the results review | -JRC--------------- | | [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py), [config_O3_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/config_O3_events.yaml) | Script for computing ML predictions for a given event pairs in dataframe, their skymaps, Qtransforms and the trained ML models. Optionally computes the False Positive Probabilities given the background. It requires config file as input. Eg: `lensid_make_predictions -config /home/srashti.goyal/lensid-ml-O3/config_O3_events.yaml` Note: change `odir` in **config** file. | JR: OK | ---------- | DC: Should be considered in the results review | -JRC--------------- |
| [get_candidates_compare_to_blu_tagged.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/get_candidates_compare_to_blu_tagged.ipynb) | Notebook for comparing ML and BLU results for the full O3 catalogue of BBHs. | JRC: OK | 09e01c8972074ee4f44120afb9095ea76c458c9f | --------- | -JRC--------------- | | [get_candidates_compare_to_blu_tagged.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/get_candidates_compare_to_blu_tagged.ipynb) | Notebook for comparing ML and BLU results for the full O3 catalogue of BBHs. | JRC: OK | 09e01c8972074ee4f44120afb9095ea76c458c9f | --------- | -JRC--------------- |
...@@ -142,7 +142,7 @@ PO statistics results used for FPP computations and making the plot. md5sum: `03 ...@@ -142,7 +142,7 @@ PO statistics results used for FPP computations and making the plot. md5sum: `03
09e01c8972074ee4f44120afb9095ea76c458c9f 09e01c8972074ee4f44120afb9095ea76c458c9f
</td> </td>
<td>---------</td> <td>---------</td>
<td>----------------</td> <td>:heavy_check_mark:</td>
</tr> </tr>
<tr> <tr>
<td> <td>
...@@ -161,7 +161,7 @@ PO statistics background injection results used for FPP computations and making ...@@ -161,7 +161,7 @@ PO statistics background injection results used for FPP computations and making
09e01c8972074ee4f44120afb9095ea76c458c9f 09e01c8972074ee4f44120afb9095ea76c458c9f
</td> </td>
<td>---------</td> <td>---------</td>
<td>----------------</td> <td>:heavy_check_mark:</td>
</tr> </tr>
<tr> <tr>
<td> <td>
...@@ -193,7 +193,7 @@ PO statistics background injection results used for FPP computations and making ...@@ -193,7 +193,7 @@ PO statistics background injection results used for FPP computations and making
09e01c8972074ee4f44120afb9095ea76c458c9f 09e01c8972074ee4f44120afb9095ea76c458c9f
</td> </td>
<td>---------</td> <td>:heavy_check_mark:</td>
<td> <td>
</td> </td>
...@@ -211,7 +211,7 @@ PO statistics background injection results used for FPP computations and making ...@@ -211,7 +211,7 @@ PO statistics background injection results used for FPP computations and making
09e01c8972074ee4f44120afb9095ea76c458c9f 09e01c8972074ee4f44120afb9095ea76c458c9f
</td> </td>
<td>---------</td> <td>:heavy_check_mark:</td>
<td> <td>
</td> </td>
...@@ -272,7 +272,7 @@ PO statistics background injection results used for FPP computations and making ...@@ -272,7 +272,7 @@ PO statistics background injection results used for FPP computations and making
## 5 January 2022 ## 5 January 2022
* We discussed the performance of XGBoost with QTs for the 2 detector real events. * We discussed the performance of XGBoost with QTs for the 2 detector real events.
* Imputing the dense outputs(i.e. input features of XGBoost) for the missing data help but is not logically understood. (notebook)\[https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/missing_strain_ML_qts.ipynb\\\] * Imputing the dense outputs(i.e. input features of XGBoost) for the missing data help but is not logically understood. (notebook)\[https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/missing_strain_ML_qts.ipynb\\\\\\\]
* We converged on the training configurations for the final ML results for O3. * We converged on the training configurations for the final ML results for O3.
### Action items: ### Action items:
......