Skip to content

Changes

Page history
Update Result Review O3b lensing authored by Srashti Goyal's avatar Srashti Goyal
Show whitespace changes
Inline Side-by-side
Result-Review-O3b-lensing.md
View page @ 97c7c6b0
......@@ -22,8 +22,8 @@ This repository deals with the result review of the machine learning based pipel
## Scripts/Configs
| Script | Short description | Status | git hash | Comment | final sign-off |
|--------|-------------------|--------|----------|---------|----------------|
| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up*` | DC: OK | 2e3215024a42c08081d612c3713ffd54fbba5f7e | ------- | -------------- |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 2e3215024a42c08081d612c3713ffd54fbba5f7e | --- | -------------- |
| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up*` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | ------- | -------------- |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | DC: OK | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67 | --- | -------------- |
| [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py), [config_O3_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/config_O3_events.yaml) | Script for computing ML predictions for a given event pairs in dataframe, their skymaps, Qtransforms and the trained ML models. Optionally computes the False Positive Probabilities given the background. It requires config file as input. Eg: `lensid_make_predictions -config /home/srashti.goyal/lensid-ml-O3/config_O3_events.yaml` Note: change `odir` in **config** file. | JR: OK | ---------- | DC: Should be considered in the results review | ---------------- |
| [get_candidates_compare_to_blu_tagged.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/get_candidates_compare_to_blu_tagged.ipynb) | Notebook for comparing ML and BLU results for the full O3 catalogue of BBHs. | JR: OK | ---------- | --------- | ---------------- |
| [condor_lensid_make_predictions.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/condor_lensid_make_predictions.py) | Condor Script for computing ML predictions and FPPs using, [ml_predict_workflow.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/package/lensid/ml_predict_workflow.py). Eg: `python condor_lensid_make_predictions` Note: change `exec_file_loc` in the script according to your installation and `odir` in config file. | OK-DC | ca47c5ce71fa7405b84c944235a8646abcd216d4 | --------- | ---------------- |
......@@ -47,6 +47,8 @@ In progress: [page](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/wikis/O3-r
## O3b paper
| Item | Short description | Status | git hash | Comment | final sign-off |
|------|-------------------|--------|----------|---------|----------------|
|[Event list](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/data_download_preparation/O3_events_updated_1feb2022.txt)|List of events considered for the O3 lensing analysis|--------|4e81d2bb94c38960e6e5d2e4104c94679a78bb67|---------|----------------|
| [Final config](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/config_O3_events_18022022.yaml) | Contains paths to the Qtransforms, Skymaps, background, machines used for producing the final results | -------- | 4e81d2bb94c38960e6e5d2e4104c94679a78bb67| --------- | ---------------- |
| [Final results](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/a0c855f18e7435d977f1fed5a2e806368fde15d8/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022) | neither ML nor PO: 2153, ML but not PO: 32, PO and BLU: 9, PO but not ML: 35| -------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
| [PO and ML plot](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML_gwtc3/results_3dec_kaggle_re_pesky_18022022/ML_BLU_scatter_hist_FPPs.pdf) | ML and PO False positive probabilities for all the O3 pairs. Threshold of FPP = 0.01 signifies the pairs considered for joint-pe analysis. | -------- | a0c855f18e7435d977f1fed5a2e806368fde15d8 | --------- | ---------------- |
......