Skip to content

Changes

Page history
Update Result Review O3b lensing authored by Jean-Rene Cudell's avatar Jean-Rene Cudell
Show whitespace changes
Inline Side-by-side
Result-Review-O3b-lensing.md
View page @ d5b2ae13
......@@ -22,15 +22,15 @@ This repository deals with the result review of the machine learning based pipel
## Scripts/Configs
| Script | Short description | Status | git hash | Comment | final sign-off |
|--------|-------------------|--------|----------|---------|----------------|
| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up*` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | ------- | -------------- |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --- | -------------- |
| [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py), [config_O3_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/config_O3_events.yaml) | Script for computing ML predictions for a given event pairs in dataframe, their skymaps, Qtransforms and the trained ML models. Optionally computes the False Positive Probabilities given the background. It requires config file as input. Eg: `lensid_make_predictions -config /home/srashti.goyal/lensid-ml-O3/config_O3_events.yaml` Note: change `odir` in **config** file. | JR: OK | ---------- | DC: Should be considered in the results review | ---------------- |
| [get_candidates_compare_to_blu_tagged.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/get_candidates_compare_to_blu_tagged.ipynb) | Notebook for comparing ML and BLU results for the full O3 catalogue of BBHs. | JR: OK | ---------- | --------- | ---------------- |
| [condor_lensid_make_predictions.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/condor_lensid_make_predictions.py) | Condor Script for computing ML predictions and FPPs using, [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py). Eg: `python condor_lensid_make_predictions` Note: change `exec_file_loc` in the script according to your installation and `odir` in config file. | OK-DC | ca47c5ce71fa7405b84c944235a8646abcd216d4 | --------- | ---------------- |
| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up*` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | ------- | JRC------------ |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --- | -JRC------------- |
| [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py), [config_O3_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/config_O3_events.yaml) | Script for computing ML predictions for a given event pairs in dataframe, their skymaps, Qtransforms and the trained ML models. Optionally computes the False Positive Probabilities given the background. It requires config file as input. Eg: `lensid_make_predictions -config /home/srashti.goyal/lensid-ml-O3/config_O3_events.yaml` Note: change `odir` in **config** file. | JR: OK | ---------- | DC: Should be considered in the results review | -JRC--------------- |
| [get_candidates_compare_to_blu_tagged.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/get_candidates_compare_to_blu_tagged.ipynb) | Notebook for comparing ML and BLU results for the full O3 catalogue of BBHs. | JR: OK | ---------- | --------- | -JRC--------------- |
| [condor_lensid_make_predictions.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/condor_lensid_make_predictions.py) | Condor Script for computing ML predictions and FPPs using, [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py). Eg: `python condor_lensid_make_predictions` Note: change `exec_file_loc` in the script according to your installation and `odir` in config file. | OK-DC | ca47c5ce71fa7405b84c944235a8646abcd216d4 | --------- | -JRC--------------- |
## Investigations
| Notebook | Short description | Status | Comment | Reviewed |
|----------|-------------------|--------|----------|---------|
|----------|-------------------|--------|---------|----------|
| [train_test_pars.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/train_test_pars.ipynb) | Notebook having plots of injection parameters for training, testing and O3a sets that are used. | JRC: OK | -------- | -------------- |
| [ML_blu_FPPs_inj_pars_investigate.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/ML_blu_FPPs_inj_pars_investigate.ipynb) | Notebook comparing the ML and BLU FPPs for each pair in test set, and also investigationg correlations with the injection parameters. Also contain statistics of input sky features for lensed and unlensed test pairs. | JRC: OK | -------- | -------------- |
| [PSD_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/PSD_plots.ipynb) | Notebook having plots of PSDs that are used. | JRC: OK | -------- | -------------- |
......@@ -47,10 +47,10 @@ In progress: [page](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/wikis/O3-r
## O3b paper
| Item | Short description | Status | git hash | Comment | final sign-off |
|------|-------------------|--------|----------|---------|----------------|
|[Event list](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/data_download_preparation/O3_events_updated_1feb2022.txt)|List of events considered for the O3 lensing analysis|--------|4e81d2bb94c38960e6e5d2e4104c94679a78bb67|---------|----------------|
| [Final config](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/config_O3_events_18022022.yaml) | Contains paths to the Qtransforms, Skymaps, background, machines used for producing the final results | -------- | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67| --------- | ---------------- |
| [Final results](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022) | neither ML nor PO: 2153, ML but not PO: 32, PO and BLU: 9, PO but not ML: 35| -------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
| [PO and ML plot](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022/ML_BLU_scatter_hist_FPPs.pdf) | ML and PO False positive probabilities for all the O3 pairs. Threshold of FPP = 0.01 signifies the pairs considered for joint-pe analysis. | -------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
| [Event list](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/data_download_preparation/O3_events_updated_1feb2022.txt) | List of events considered for the O3 lensing analysis | OK-JRC-------- | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --------- | ---------------- |
| [Final config](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/config_O3_events_18022022.yaml) | Contains paths to the Qtransforms, Skymaps, background, machines used for producing the final results | OK-JRC-------- | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --------- | ---------------- |
| [Final results](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022) | neither ML nor PO: 2153, ML but not PO: 32, PO and BLU: 9, PO but not ML: 35 | OK-JRC-------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
| [PO and ML plot](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022/ML_BLU_scatter_hist_FPPs.pdf) | ML and PO False positive probabilities for all the O3 pairs. Threshold of FPP = 0.01 signifies the pairs considered for joint-pe analysis. | OK-JRC-------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
## Additional: Targeted Sub-threshold Search
| Script/Notebook | Short description | Status | git hash | Comment | final sign-off |
......