... | @@ -27,14 +27,14 @@ This repository deals with the result review of the machine learning based pipel |
... | @@ -27,14 +27,14 @@ This repository deals with the result review of the machine learning based pipel |
|
## Investigations
|
|
## Investigations
|
|
| Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
| Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
|----------|-------------------|--------|----------|---------|----------------|
|
|
|----------|-------------------|--------|----------|---------|----------------|
|
|
| [train_test_pars.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/train_test_pars.ipynb) | Notebook having plots of injection parameters for training, testing and O3a sets that are used. | JR: OK | -------- | ------- | -------------- |
|
|
| [train_test_pars.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/train_test_pars.ipynb) | Notebook having plots of injection parameters for training, testing and O3a sets that are used. | JRC: OK | -------- | ------- | -------------- |
|
|
| [ML_blu_FPPs_inj_pars_investigate.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/ML_blu_FPPs_inj_pars_investigate.ipynb) | Notebook comparing the ML and BLU FPPs for each pair in test set, and also investigationg correlations with the injection parameters. Also contain statistics of input sky features for lensed and unlensed test pairs. | JR: OK | -------- | ------- | -------------- |
|
|
| [ML_blu_FPPs_inj_pars_investigate.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/ML_blu_FPPs_inj_pars_investigate.ipynb) | Notebook comparing the ML and BLU FPPs for each pair in test set, and also investigationg correlations with the injection parameters. Also contain statistics of input sky features for lensed and unlensed test pairs. | JRC: OK | -------- | ------- | -------------- |
|
|
| [PSD_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/PSD_plots.ipynb) | Notebook having plots of PSDs that are used. | JR: OK | -------- | ------- | -------------- |
|
|
| [PSD_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/PSD_plots.ipynb) | Notebook having plots of PSDs that are used. | JRC: OK | -------- | ------- | -------------- |
|
|
|[hp_cartview.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/hp_cartview.ipynb) | Sanity check for bayestar skymaps to see overall probability and the overlap calculation for cartesian projection v/s the flattened fits. | JR: OK | ------- | --------- | ---------------- |
|
|
|[hp_cartview.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/hp_cartview.ipynb) | Sanity check for bayestar skymaps to see overall probability and the overlap calculation for cartesian projection v/s the flattened fits. | JRC: OK | ------- | --------- | ---------------- |
|
|
| [background_injections_ML_blu.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/O3a_events/background_injections_ML_blu.ipynb) | Notebook showing ML and BLU outputs for the background unlensed injections as simulated by Haris during O3a analysis. | JR: OK | -------- | ------- | -------------- |
|
|
| [background_injections_ML_blu.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/O3a_events/background_injections_ML_blu.ipynb) | Notebook showing ML and BLU outputs for the background unlensed injections as simulated by Haris during O3a analysis. | JRC: OK | -------- | ------- | -------------- |
|
|
| [investigations_visualisations.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/investigations_visualisations.ipynb) | Notebook to visualise qtransforms and skymaps of the interesting candidate real event pairs. | JR: OK | | --------- | ---------------- |
|
|
| [investigations_visualisations.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/investigations_visualisations.ipynb) | Notebook to visualise qtransforms and skymaps of the interesting candidate real event pairs. | JRC: OK | | --------- | ---------------- |
|
|
| [optimise_densenets.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/development/optimise_densenets.py) | Optimise densenet learning rates, with and without whitening of strain | JR: OK | ------- | --------- | ---------------- |
|
|
| [optimise_densenets.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/development/optimise_densenets.py) | Optimise densenet learning rates, with and without whitening of strain | JRC: OK | ------- | --------- | ---------------- |
|
|
|[missing_strain_ML_qts.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/missing_strain_ML_qts.ipynb) | Implement XGBoost with QTs using imputed values instead of 1s(default) for the single/double detector real events. Additionally compare the results of PO and ML to Golum for the selected candidates. | JR: OK | ------- | --------- | ---------------- |
|
|
|[missing_strain_ML_qts.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/review/missing_strain_ML_qts.ipynb) | Implement XGBoost with QTs using imputed values instead of 1s(default) for the single/double detector real events. Additionally compare the results of PO and ML to Golum for the selected candidates. | Needs further investigation | ------- | --------- | ---------------- |
|
|
|
|
|
|
## Results
|
|
## Results
|
|
|
|
|
... | @@ -51,6 +51,6 @@ In progress: [page](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/wikis/O3-r |
... | @@ -51,6 +51,6 @@ In progress: [page](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/wikis/O3-r |
|
## Additional: Targeted Sub-threshold Search
|
|
## Additional: Targeted Sub-threshold Search
|
|
| Script/Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
| Script/Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
|--------|-------------------|--------|----------|---------|----------------|
|
|
|--------|-------------------|--------|----------|---------|----------------|
|
|
|[sub_data_download_prep.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/sub_data_download_prep.ipynb)|Subthreshold candidates data downloading and preparing Qtransforms and input sky features for ML analysis| JR: OK |----------|---------|----------------|
|
|
|[sub_data_download_prep.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/sub_data_download_prep.ipynb)|Subthreshold candidates data downloading and preparing Qtransforms and input sky features for ML analysis| JRC: OK |----------|---------|----------------|
|
|
|[config_O3_super_sub_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/configs/config_O3_super_sub_events.yaml)|Config used for producing the preliminary results with the `lensid_make_predictions` command line.| JR: OK |----------|---------|----------------|
|
|
|[config_O3_super_sub_events.yaml](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/configs/config_O3_super_sub_events.yaml)|Config used for producing the preliminary results with the `lensid_make_predictions` command line.| JRC: OK |----------|---------|----------------|
|
|
|[get_candidates_super_sub.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/get_candidates_super_sub.ipynb)|Notebook for loading the results and sorting candidates| JR: OK |----------|---------|----------------| |
|
|[get_candidates_super_sub.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/subthreshold/get_candidates_super_sub.ipynb)|Notebook for loading the results and sorting candidates| JRC: OK |----------|---------|----------------| |