|
Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results
|
|
## Details of the review of SIQM-O3a-TGR analysis
|
|
|
|
|
|
|
|
* Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results
|
|
|
|
|
|
|
|
### Table 1: List of events from O3a
|
|
|
|
|
|
|No.| NAME | Comments on config ini file|Comments on results from the reviewer | Reviewees comments |Final status|
|
|
|No.| NAME | Comments on config ini file|Comments on results from the reviewer | Reviewees comments |Final status|
|
|
|---| ---- | ---- | ---- | --- |--- |
|
|
|---| ---- | ---- | ---- | --- |--- |
|
... | @@ -16,8 +20,7 @@ Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3 |
... | @@ -16,8 +20,7 @@ Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3 |
|
|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: something very incorrect in the comparison pages which I see as of May 29 -- everything is estimated differently. Good that this is being rerun.|Saleem: Rerunning after removing the mtotal priors |Being rerun|
|
|
|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: something very incorrect in the comparison pages which I see as of May 29 -- everything is estimated differently. Good that this is being rerun.|Saleem: Rerunning after removing the mtotal priors |Being rerun|
|
|
|13.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)<br> person responsible: Saleem||<br> Anuradha: <br> BBH: m1 and mtotal are railing at the boundary. <br>ks_pos: I hope it is a typo, it says BBH vs PE run. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> ks_sym: mtotal is railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: is the PE run used for comparison a production PE run? PE run seems to have very restrictive distance priors. Why is everything estimated better for the SIQM run then for the PE run? PE run shows mtot railing. SIQM run shows a very marginal mtot railing. <br><br> Anuradha: looks good. **SIGNED OFF** <br><br> Archisman: mtot falls of very fast to the left of the peak, but no railing. SIQM typical, but seems ragged; more samples might help. **SIGNED OFF!** | Saleem: The results are now updated with the latest runs. earlier runs used an older lalsuite installation. The results are not expected to be different. The typos in labels are fixed and posteriors are now made from more number of samples. From manually plotting the posteriors, there is no railing against prior for Mtotal. Also, no Mtot prior is imposed in the config for this event. <br> <br> Please see if there is an issue of insufficient sampling |Ready to be reviewed|
|
|
|13.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)<br> person responsible: Saleem||<br> Anuradha: <br> BBH: m1 and mtotal are railing at the boundary. <br>ks_pos: I hope it is a typo, it says BBH vs PE run. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> ks_sym: mtotal is railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: is the PE run used for comparison a production PE run? PE run seems to have very restrictive distance priors. Why is everything estimated better for the SIQM run then for the PE run? PE run shows mtot railing. SIQM run shows a very marginal mtot railing. <br><br> Anuradha: looks good. **SIGNED OFF** <br><br> Archisman: mtot falls of very fast to the left of the peak, but no railing. SIQM typical, but seems ragged; more samples might help. **SIGNED OFF!** | Saleem: The results are now updated with the latest runs. earlier runs used an older lalsuite installation. The results are not expected to be different. The typos in labels are fixed and posteriors are now made from more number of samples. From manually plotting the posteriors, there is no railing against prior for Mtotal. Also, no Mtot prior is imposed in the config for this event. <br> <br> Please see if there is an issue of insufficient sampling |Ready to be reviewed|
|
|
|
|
|
|
**Details of O1/O2 events**
|
|
### Table 2: List of events from O1 and O2
|
|
|
|
|
|
|
|
|
|
|No.| NAME | Comments on config ini file|Comments on results | Reviewees comments |Final status|
|
|
|No.| NAME | Comments on config ini file|Comments on results | Reviewees comments |Final status|
|
|
|---| ---- | ---- | ---- | --- |--- |
|
|
|---| ---- | ---- | ---- | --- |--- |
|
... | @@ -28,6 +31,14 @@ Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3 |
... | @@ -28,6 +31,14 @@ Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3 |
|
|5. |[GW170814](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170814)<br> person responsible: Krishnendu | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why a1 and a2 are totally unconstrained? <br> <br> Archisman: spin angles are different (generic); mtot is fine. Why is dL so different? Why are sky angles not estimated in the SIQM run? Was a 2 detector run launched by mistake? <br> Anuradha: same question about DL and sky angles. Ks plots missing. <br><br> Anuradha: Please confirm the Bayes factor for BBH case. Why Phi_JL are different in all 3 comparison?|<br>Krishnendu: Comparison pages added now <br> <br> BFs [BH runs with SIQM](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/O1_O2/GW170814_G297595/pv2_c01_prod/bh/home.html) is 126.44 and for the [Prod0 run](https://ldas-jobs.ligo.caltech.edu/~jacob.lange/LALInference/O2_PE/C02-cleaned-final/G297595-C02-cleaned-H1L1V1-IMRPv2-rererun/lalinferencenest/IMRPhenomPv2pseudoFourPN/1186741861.53-0/V1H1L1/posplots.html) is 125.411 |Results ready for review|
|
|
|5. |[GW170814](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170814)<br> person responsible: Krishnendu | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why a1 and a2 are totally unconstrained? <br> <br> Archisman: spin angles are different (generic); mtot is fine. Why is dL so different? Why are sky angles not estimated in the SIQM run? Was a 2 detector run launched by mistake? <br> Anuradha: same question about DL and sky angles. Ks plots missing. <br><br> Anuradha: Please confirm the Bayes factor for BBH case. Why Phi_JL are different in all 3 comparison?|<br>Krishnendu: Comparison pages added now <br> <br> BFs [BH runs with SIQM](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/O1_O2/GW170814_G297595/pv2_c01_prod/bh/home.html) is 126.44 and for the [Prod0 run](https://ldas-jobs.ligo.caltech.edu/~jacob.lange/LALInference/O2_PE/C02-cleaned-final/G297595-C02-cleaned-H1L1V1-IMRPv2-rererun/lalinferencenest/IMRPhenomPv2pseudoFourPN/1186741861.53-0/V1H1L1/posplots.html) is 125.411 |Results ready for review|
|
|
|
|
|
|
|
|
|
|
|
|
### Table 3: Main scripts used for post-processing
|
|
|
|
|
|
|
|
|No.| NAME | Purpose|Comments from the reviewer | Reviewees comments |Final status|
|
|
|
|
|---| ---- | ---- | ---- | --- |--- |
|
|
|
|
|1. | |Generating plots, calculating BFs, combining the posteriors | | ||
|
|
|
|
|2. | <br> a. [summary_ks_pos.py](https://git.ligo.org/muhammed.saleem/o3siqm-updates/-/blob/master/script/summary_ks_pos.py)<br> a. [summary_ks_sym.py](https://git.ligo.org/muhammed.saleem/o3siqm-updates/-/blob/master/script/summary_ks_sym.py)|Run PE summary for creating release ready format | | ||
|
|
|
|
|3. | [clone_repo.py](https://git.ligo.org/muhammed.saleem/o3siqm-updates/-/blob/master/script/clone_repo.py) |git clone the `sim` event directories for each event | ||
|
|
|
|
|4. | [upload2repo.py](https://git.ligo.org/muhammed.saleem/o3siqm-updates/-/blob/master/script/upload2repo.py) |upload the data to `sim` event directories for each event | ||
|
|
**Misc**
|
|
**Misc**
|
|
|
|
|
|
Archisman's script for reviewing configs: https://ldas-jobs.ligo.caltech.edu/~archisman.ghosh/LVC/TGR-O3/SIQM/config_review.sh |
|
Archisman's script for reviewing configs: https://ldas-jobs.ligo.caltech.edu/~archisman.ghosh/LVC/TGR-O3/SIQM/config_review.sh |