O3a-Spin-Quadrupole-BH-mimicker-test-results/o3a-review-report.md

@@ -9,7 +9,7 @@
 |No.| NAME | Comments on config ini file|Comments on results from the reviewer | Reviewees comments |Final status|PSD issue affected or not|
 |---| ---- | ---- |  ---- | --- |--- |----|
 |1. |[GW190408a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190408a)<br> person responsible: Krishnendu| |<br> Anuradha:<br>BBH run: In think there is a typo in labeling, it should be BBH not ks_pos.<br> ks_pos/ks_sym: The logL is different. S1z and S2z are broader than BBH run, and hence effective spin is broader than BBH run. Mtotal and Mc are shifted towards lower values. <br> <br> Archisman: looks fine. **SIGNED OFF!** <br> Anuradha: **SIGNED OFF!**|<br> Difference in SNR and logL are expected. [Discussion on matter-]most(https://chat.ligo.org/ligo/pl/n1rhn8sdt7g89muqe45iumdixa) <br> In order to make sure that the logL difference not affected our analsyis we can check the BFs and compare the one from PE Prod run and the one obtained from our BBH run. <br> In this case, log(BF)-PE PROD is 94.99 and SIQM-BH run is 95.2, hence no issues.| **SIGNED OFF!** |<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
-|2. |[GW190412m](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190412m)<br> person responsible: Krishnendu||<br>  Anuradha: <br> BBH run: Why log L is so different?<br>ks_pos: Why log L is so different? cos(alpha) is very different. chi_eff, q and Mc have shifted towards lower values. Mtotal and m1 are railing at the lower side. <br>ks_sym: Why log L is so different? Mtotal and m1 are railing at the lower side. q has shifted to higher values. <br> <br> Archisman: needs rerun with wider mtot prior. <br> <br> Archisman (on reruns): cosalpha for pos? Looks good otherwise. <br><br>Anuradha (on rerun) :<br>BBH:Please confirm the Bayes factor values. Why t0, azimuth and cos(alpha) are different?<br>ks_sym: Why t0 and cos(alpha) are different?|<br> Krishnendu: <br> On the rerun comments <br> log(BF) from [PE Prod](https://ldas-jobs.ligo.caltech.edu/~daniel.williams/LVC/projects/O3/C01/S190412m/Prod0/home.html) run 138.28  and from the [SIQM BH run](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190412m/pv2_c01_prod/comp_PE_Prod0_mtotalwiderprior/bh_bh/home.html) is again 138.28 |Reruns are over. Waiting for comments from reviewers|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
+|2. |[GW190412m](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190412m)<br> person responsible: Krishnendu||<br>  Anuradha: <br> BBH run: Why log L is so different?<br>ks_pos: Why log L is so different? cos(alpha) is very different. chi_eff, q and Mc have shifted towards lower values. Mtotal and m1 are railing at the lower side. <br>ks_sym: Why log L is so different? Mtotal and m1 are railing at the lower side. q has shifted to higher values. <br> <br> Archisman: needs rerun with wider mtot prior. <br> <br> Archisman (on reruns): cosalpha for pos? Looks good otherwise. <br><br>Anuradha (on rerun) :<br>BBH:Please confirm the Bayes factor values. Why t0, azimuth and cos(alpha) are different?<br>ks_sym: Why t0 and cos(alpha) are different?<br> Anuradha: The difference in extrinsic parameters are attributed to difference in PSDs. **SIGNED OFF!** |<br> Krishnendu: <br> On the rerun comments <br> log(BF) from [PE Prod](https://ldas-jobs.ligo.caltech.edu/~daniel.williams/LVC/projects/O3/C01/S190412m/Prod0/home.html) run 138.28  and from the [SIQM BH run](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190412m/pv2_c01_prod/comp_PE_Prod0_mtotalwiderprior/bh_bh/home.html) is again 138.28 |Reruns are over. Waiting for comments from reviewers|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
 |3. |[GW190425z](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190425z)<br> person responsible: Krishnendu|| Archisman: still running. **Please link intermediate postprocessing pages!** |||<br> Not affected by the PSD difference|
 |4.|[GW190512b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190512at)<br> person responsible: Krishnendu||<br> <br> Anuradha: BBH: Why log L is different? <br> <br> Archisman: whys is t0 different? Is the BH run used for comparison a non-spinning run? <br> <br> Archisman (following Krishnendu's first comment): This looks better, thanks! There is a minor mtot railing. We need to decide what to do for runs such as these. <br> <br> Archisman: for symmetric, mtotal is bimodal. **ATTENTION:** Rerun is necessary for this event. Railing of mtotal is clear on this [postproc](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/sym/ks/1241719652.42-0/V1H1L1/posplots.html) page. <br> <br> Anuradha (on reruns): <br> BBH: please confirm the Bayes factor<ks_pos> ks is totally unconstrained. It is expected for this kind of event? <br> <br> Archisman (on reruns): mchirp and mtotal are **bimodal**. No mtot railing. SIQM peak at slightly negative value. Totally unconstrained on positive side. Archisman **SIGNED OFF!**| <br> Krishnendu <br> Yes, this is now being addressed. I used Prod4 results for comparison and which was a non-spinning run. Now it is fixed. <br> <br> Krishnendu: <br> logL difference will not affect this case as well (BFs 53.17 [bh case](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/bh/1241719652.42-0/V1H1L1/posplots.html) and 52.14 [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/pos/ks/1241719652.42-0/V1H1L1/posplots.html) )<br> <br> Krishnendu: Currently, I am passing the following in the [config file](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/config/Prod0_IMRPP_S190512at_Ks_pos.ini) for the mass parameters. The config file for [Prod0 config file](https://git.ligo.org/pe/O3/S190512at/-/tree/master/C01_offline) also uses the same q-min = 0.125, mtotal-min = 40, mtotal-max = 65. In [this](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_bh/), the BH run using our settings is compared with the PE-Prod0 results. Both the runs give almost same mtotal, mchirp posteriors (no prior railing) but for [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_pos/) and[ks_sym](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_sym/) cases there is a difference in the mchip estimate and the total mass shifted to lower mass end. <br> Any suggestion for rerun will be useful <br> <br> Rerun started with extending mtotal from mtotal-min = 20 to mtotal-max = 65 <br> Runs are over and waiting for results <br><br> Krishnendu: <br> On the rerun comments <br> log(BF) from [PE Prod](https://ldas-jobs.ligo.caltech.edu/~daniel.williams/projects/O3/S190512at/Prod0/home.html) run 51.48  and from the [SIQM BH run](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/rerun/bh/home.html) is 53.06 <br> ks_pos being unconstrained is not surprising given the nature of [ks_sym posterior](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/rerun/ks_sym/plots/ks_sym_1d_posterior_dQuadMonS.png) where negative side is better constrained <br> it is hard to find an explaination for the ks_sym asymetry from the completely unconstrained spin posteriors |Reruns are over. Addressed comments from reviewers <br><br> **SIGNED OFF!**|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
 |5.|[GW190521r](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190521r) <br> person responsible: Saleem|  | <br>Anuradha:<br> BBH: Why log L is different? <br> ks_pos: Why log L is different? q is shifted toward lower side. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Why log L is different? 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: Spins and spin angles are different (expected). Looks good. **SIGNED OFF!** <br><br> Anuradha: looks good. **SIGNED OFF** || **SIGNED OFF!**|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|