... | @@ -72,16 +72,12 @@ yet to add cross-validate + ensemble + test script for QTs and a script for comb |
... | @@ -72,16 +72,12 @@ yet to add cross-validate + ensemble + test script for QTs and a script for comb |
|
|
|
|
|
<details><summary> yet to change </summary>
|
|
<details><summary> yet to change </summary>
|
|
|
|
|
|
## Top-level scripts: Training and testing workflow.
|
|
## Other scripts
|
|
| Scripts | Short description | Status | git hash | Comment | final sign-off |
|
|
| Scripts | Short description | Status | git hash | Comment | final sign-off |
|
|
|---------|-------------------|--------|----------|---------|----------------|
|
|
|---------|-------------------|--------|----------|---------|----------------|
|
|
| [condor_data_gen_train_test_config.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/condor_data_gen_train_test_config.py) | Generate Qtransforms, Dataframes, Bayestar skymaps for training and testing given the injection parameters using condor dag jobs submission. Note: change `exec_file_loc` in the script according to your installation and `base_out_dir` as desired. | OK-jrc; OK-DC | 493ea099f42fc50d2cc081754d5395f57fafae76 | --------- | ---------------- |
|
|
| [condor_data_gen_train_test_config.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/condor_data_gen_train_test_config.py) | Generate Qtransforms, Dataframes, Bayestar skymaps for training and testing given the injection parameters using condor dag jobs submission. Note: change `exec_file_loc` in the script according to your installation and `base_out_dir` as desired. Eg: [config_train_test_workflow.yaml](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/config_train_test_workflow.yaml) | OK-jrc; OK-DC | 493ea099f42fc50d2cc081754d5395f57fafae76 | --------- | ---------------- |
|
|
| [config_train_test_workflow.yaml](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/config_train_test_workflow.yaml) | config file for training and testing ML models. Note: change `base_out_dir` as desired. | OK-DC; question-jrc | | | |
|
|
| | config file for training and testing ML models. Note: change `base_out_dir` as desired. | OK-DC; question-jrc | | very minor change, just added `request_disk` option [diff](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/review/diff_condor_data_gen.diff) | |
|
|
| [train_three_densenets.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/train_three_densenets.py) | Trains the three densenets, needs **config** file as input. Runs very fast on GPU systems. Optionally one can use condor to submit it as job. `python train_three_densenets.py` | OK-DC; OK-jrc | a60740bb5a0cccb2be8e8184f16c0c7c93f8150b | | ---------------- |
|
|
|
|
| [condor_train_test_features_extraction.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/condor_train_test_features_extraction.py) | Extract sky and qts features of the training and testing dataset by condor dag jobs submission. Needs **config** file as input. | OK-DC; OK-jrc | 493ea099f42fc50d2cc081754d5395f57fafae76 | --------- | ---------------- |
|
|
|
|
| [train_test_XGBs.py](https://git.ligo.org/srashti.goyal/lensid/-/blob/master/train_test_workflow/train_test_XGBs.py) | Train and test the QTs and Skymaps machine learning models, optionally compare to BLU. Needs **config** as input. Runs in <5 mins, optionally can be submitted using condor. | OK-jrc; OK-DC | a60740bb5a0cccb2be8e8184f16c0c7c93f8150b | | ---------------- |
|
|
|
|
|
|
|
|
</details>
|
|
|
|
|
|
|
|
# Review Calls
|
|
# Review Calls
|
|
|
|
|
... | | ... | |