| [data_download.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_download.py) | Script for downloading events info, skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path(line 26) for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*` | | | ------- | |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o3/-/blob/master/data_download_preparation/data_prepare.py) | Preparing Qtransform images, dataframes and skymaps for O3 real events given the event list and raw data downloaded from LIGO servers. Note: raw data on CIT is in `/home/srashti.goyal/lensid-ml-o3/data_download_preparation/O3` | | | --- | |
| [data_download_cbcflow.py](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/data_download_preparation/data_download_cbcflow.py) | Script for downloading events info from CBCFlow (path loaded on CIT), skymaps(.fits) from GraceDB and strain data from ligo servers using GWpy. Note: needs valid ligo key path for accessing non-public data in Gracedb., eg: `/tmp/x509up\\\\\\\*`Raw data on CIT is in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_events_data`| | | ------- | |
| [data_prepare.py](https://git.ligo.org/srashti.goyal/lensid-ml-o4/-/blob/master/data_download_preparation/data_prepare.py) | Prepare cartesian skymaps and qtransforms for O4a the real events. Also filters events compatible with lensid (BBHs) and prepares a dataframe. Note: The prepared inputs are saved on CIT in `/home/srashti.goyal/lensid_O4/data_download_preparation/O4a_lensid_inputs` | | | --- | |
<details><summary>**OLD**</summary>
## Investigations
| Notebook | Short description | Status | Comment | Reviewed |
...
...
@@ -79,7 +78,19 @@ The review call happen on Wednesdays 1 PM CEST/ 4:30 PM IST virtual IFPA room: h
* We also discussed the data preparation for O4, using the CBCflow and which skymaps to use.
## Action items
- [x] Write data download and preparation scripts.
## 17 August 2023
* We discussed the data download and preparation scripts line by line.
* We also discussed the status of Virgo.
* We are inclining towards using uniform pop-trained machine for the production
* We also discussed lensingflow integration and the possibility of Asimov.
## Action items
- [ ] Plot ROCs varying the SNRs.
- [ ] Gather and organise the results.
- [ ] Write data download and preparation scripts.
