| ... | ... | @@ -105,12 +105,10 @@ The ML model predictions are compared to posterior overlap statistic results als |
|
|
|
## ML models: Training, Cross-validation, Optimisation, Testing, Comparison with BLU, Investigations.
|
|
|
|
| Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
|
|
|----------|-------------------|--------|----------|---------|----------------|
|
|
|
|
| [train_densenets_QTs.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/training_cv/train_densenets_QTs.ipynb) | Notebook that trains 3 DenseNets(CNN) for 3 detector Q-tranforms. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_crossvalidate_XGB_QTs.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/training_cv/train_crossvalidate_XGB_QTs.ipynb) | Notebook that trains and cross-validates "XGBoost with QTs" model. Requires dataframe that already has the input features calculated from the Qtransform images and trained DenseNets. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_crossvalidate_XGB_sky.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/training_cv/train_crossvalidate_XGB_sky.ipynb) | Notebook that trains and cross-validates "XGBoost with Skymaps" model. Requires dataframe that already has the input features calculated from the Bayestar/PE skymaps | ------ | -------- | ------- | -------------- |
|
|
|
|
| [test_QTs_ML.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/testing_cv_calc_fpp/test_QTs_ML.ipynb) | Notebook that tests ML with Qtransforms and compare ROCs with $B^L_U$ statistic for the haris-et-al dataset. Requires trained "XGBoost with QTs" model and its input features, also requires $B^L_U$ values for comparison. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [test_skymaps_ML.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/testing_cv_calc_fpp/test_skymaps_ML.ipynb) | Notebook that tests ML with Skymaps and compare ROCs with $B^L_U$ statistic for the haris-et-al dataset. Requires trained "XGBoost with Skymaps" model and its input features, also requires $B^L_U$ values for comparison. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [test_combined_ML_results.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/notebooks/testing_cv_calc_fpp/test_combined_ML_results.ipynb) | Notebook that combines individual ML outputs for Qtransforms and Skymaps, and compares the ROCs with $B^L_U$ statistic for the haris-et-al dataset. Also requires $B^L_U$ values for comparison. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_densenets_qts.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/scripts/train_densenets_qts.py) | Train densenet with qtransform for a given detector. Eg: `python train_densenets_qts.py -lensed_df ~/strong-lensing-ml/data/dataframes/train/lensed.csv -unlensed_df ~/strong-lensing-ml/data/dataframes/train/unlensed_half.csv -odir dense_out/cit/ -epochs 10 -data_dir ~/alice_data_lensid/qts/train/`. Note: tensorflowenv on pcdev12@CIT has GPU | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_crossvalidate_test_XGB_qts.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/scripts/train_crossvalidate_test_XGB_qts.py) | Trains, cross-validate and compare to BLU "XGBoost with QTs" model. Requires dataframe that already has the input features calculated from the Qtransform images and trained DenseNets. `python train_crossvalidate_test_XGB_qts.py ` | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_crossvalidate_test_XGB_sky.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/scripts/train_crossvalidate_test_XGB_sky.py) | Train, cross-validates and compare to BLU "XGBoost with Skymaps" model. Requires dataframe that already has the input features calculated from the Bayestar/PE skymaps. `python train_crossvalidate_test_XGB_sky.py ` | ------ | -------- | ------- | -------------- |
|
|
|
|
| [test_combined_ML_results.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/scripts/test_combined_ML_results.py) | Test and compare to BLU overall ML model. Requires dataframes that already has the ML predictions calculated from the qts and skymaps. `python test_combined_ML_results.py ` | ------ | -------- | ------- | -------------- |
|
|
|
|
| [train_test_pars.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/train_test_pars.ipynb) | Notebook having plots of injection parameters for training, testing and O3a sets that are used. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [ML_blu_FPPs_inj_pars_investigate.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/ML_blu_FPPs_inj_pars_investigate.ipynb) | Notebook comparing the ML and BLU FPPs for each pair in test set, and also investigationg correlations with the injection parameters. Also contain statistics of input sky features for lensed and unlensed test pairs. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [PSD_plots.ipynb](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/PSD_plots.ipynb) | Notebook having plots of PSDs that are used. | ------ | -------- | ------- | -------------- |
|
| ... | ... | @@ -122,7 +120,7 @@ The ML model predictions are compared to posterior overlap statistic results als |
|
|
|
| Notebook | Short description | Status | git hash | Comment | final sign-off |
|
|
|
|
|----------|-------------------|--------|----------|---------|----------------|
|
|
|
|
| [download_data.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/download_data.ipynb) | Notebook for downloading skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [data_preparation.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_preparation.ipynb) | Notebook for preparing Qtransform images, dataframes and skymaps for O3 real events. | ------ | -------- | ------- | -------------- |
|
|
|
|
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | ------ | -------- | ------- | -------------- |
|
|
|
|
| [ML_pred_O3.ipynb](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/O3_ML/ML_pred_O3.ipynb) | Notebook showing ML and BLU False positive probabilities for the O3 real events and comparison with BLU for O3a events. | ------ | -------- | ------- | -------------- |
|
|
|
|
|
|
|
|
# Meetings
|
| ... | ... | |
