O3a-Spin-Quadrupole-BH-mimicker-test-results/o3a-review-report.md

@@ -5,7 +5,7 @@ Main results review page: https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3
 |1. |[GW190408a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190408a)| |<br> Anuradha:<br>BBH run: In think there is a typo in labeling, it should be BBH not ks_pos.<br> ks_pos/ks_sym: The logL is different. S1z and S2z are broader than BBH run, and hence effective spin is broader than BBH run. Mtotal and Mc are shifted towards lower values. <br> <br> Archisman: looks fine. **SIGNED OFF!** <br> Anuradha: **SIGNED OFF!**|<br> Difference in SNR and logL are expected. [Discussion on matter-]most(https://chat.ligo.org/ligo/pl/n1rhn8sdt7g89muqe45iumdixa) <br> In order to make sure that the logL difference not affected our analsyis we can check the BFs and compare the one from PE Prod run and the one obtained from our BBH run. <br> In this case, log(BF)-PE PROD is 94.99 and SIQM-BH run is 95.2, hence no issues.| No rerun|
 |2. |[GW190412m](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190412m)||<br>  Anuradha: <br> BBH run: Why log L is so different?<br>ks_pos: Why log L is so different? cos(alpha) is very different. chi_eff, q and Mc have shifted towards lower values. Mtotal and m1 are railing at the lower side. <br>ks_sym: Why log L is so different? Mtotal and m1 are railing at the lower side. q has shifted to higher values. <br> <br> Archisman: needs rerun with wider mtot prior.||Rerun|
 |3. |[GW190425z](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190425z)|| Archisman: still running ||
-|4.|[GW190512b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190512at)||<br> <br> Anuradha: BBH: Why log L is different? <br> <br> Archisman: whys is t0 different? Is the BH run used for comparison a non-spinning run? <br> <br> Archisman (following Krishnendu's first comment): This looks better, thanks! There is a minor mtot railing. We need to decide what to do for runs such as these. <br> <br> Archisman: for symmetric, mtotal is bimodal. **ATTENTION:** Rerun is necessary for this event. Railing of mtotal is clear on this [postproc](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/sym/ks/1241719652.42-0/V1H1L1/posplots.html) page. | <br> Krishnendu <br> Yes, this is now being addressed. I used Prod4 results for comparison and which was a non-spinning run. Now it is fixed. <br> <br> Krishnendu: <br> logL difference will not affect this case as well (BFs 53.17 [bh case](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/bh/1241719652.42-0/V1H1L1/posplots.html) and 52.14 [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/pos/ks/1241719652.42-0/V1H1L1/posplots.html) )<br> <br> Krishnendu: Currently, I am passing the following in the [config file](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/config/Prod0_IMRPP_S190512at_Ks_pos.ini) for the mass parameters. The config file for [Prod0 config file](https://git.ligo.org/pe/O3/S190512at/-/tree/master/C01_offline) also uses the same q-min = 0.125, mtotal-min = 40, mtotal-max = 65. In [this](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_bh/), the BH run using our settings is compared with the PE-Prod0 results. Both the runs give almost same mtotal, mchirp posteriors (no prior railing) but for [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_pos/) and[ks_sym](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_sym/) cases there is a difference in the mchip estimate and the total mass shifted to lower mass end. <br> Any suggestion for rerun will be useful |Rerun|
+|4.|[GW190512b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190512at)||<br> <br> Anuradha: BBH: Why log L is different? <br> <br> Archisman: whys is t0 different? Is the BH run used for comparison a non-spinning run? <br> <br> Archisman (following Krishnendu's first comment): This looks better, thanks! There is a minor mtot railing. We need to decide what to do for runs such as these. <br> <br> Archisman: for symmetric, mtotal is bimodal. **ATTENTION:** Rerun is necessary for this event. Railing of mtotal is clear on this [postproc](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/sym/ks/1241719652.42-0/V1H1L1/posplots.html) page. | <br> Krishnendu <br> Yes, this is now being addressed. I used Prod4 results for comparison and which was a non-spinning run. Now it is fixed. <br> <br> Krishnendu: <br> logL difference will not affect this case as well (BFs 53.17 [bh case](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/bh/1241719652.42-0/V1H1L1/posplots.html) and 52.14 [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/pos/ks/1241719652.42-0/V1H1L1/posplots.html) )<br> <br> Krishnendu: Currently, I am passing the following in the [config file](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/config/Prod0_IMRPP_S190512at_Ks_pos.ini) for the mass parameters. The config file for [Prod0 config file](https://git.ligo.org/pe/O3/S190512at/-/tree/master/C01_offline) also uses the same q-min = 0.125, mtotal-min = 40, mtotal-max = 65. In [this](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_bh/), the BH run using our settings is compared with the PE-Prod0 results. Both the runs give almost same mtotal, mchirp posteriors (no prior railing) but for [ks_pos](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_pos/) and[ks_sym](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190512at/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_ks_sym/) cases there is a difference in the mchip estimate and the total mass shifted to lower mass end. <br> Any suggestion for rerun will be useful <br> <br> Rerun started with extending mtotal from mtotal-min = 20 to mtotal-max = 65 |Rerun|
 |5.|[GW190521r](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190521r) |  | <br>Anuradha:<br> BBH: Why log L is different? <br> ks_pos: Why log L is different? q is shifted toward lower side. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Why log L is different? 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: Spins and spin angles are different (expected). Looks good. **SIGNED OFF!** || No rerun|
 |6.|[GW190630a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190630ag)| |<br>Anuradha: <br>BBH: Why is log L different? <br> ks_pos: Why is log L different? a1, a2 and chi_eff are less constrained. <br> Why is log L different?<br> ks_sym: no comparison page <br> <br> Archisman: where are the comparison pages? I could not find them. <br> <br> Archisman: Sorry, I still cannot find the comparison plots. I get to the following summary page, but I do not see any plot: https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/bh_ks_pos/home.html <br> <br> Is there an old-school post-processing page for an SIQM run for this event? <br>Anuradha: looks good. **SIGNED OFF!** |<br> Krishnendu <br> <br> Please see this page for [PE results](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/) are the comparison page with PE Prod runs <br><br> Please find the cbcBayesCompPos page [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/) <br><br> Krishnendu (answering comments from Anuradha): <br> BBH logL difference again can be ignored everything else inclusing the BFs match here (PE Prod BF 98.82 and SIQM-BBH BFs 98.46 see [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/bh_bh/home.html)) <br> compared to the BH estimate there is a slight difference in the [chirp-mass](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/bh_ks_sym/html/Comparison_chirp_mass.html), [chi_eff](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/bh_ks_sym/html/Comparison_chi_eff.html) and I think this is expected.|Waiting for comments|
 |7.|[GW190707a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190707q)||<br> Anuradha: All the comparison pages have 'Prod0' vs 'Prod4' legends, so I am not sure if I am looking are correct plots. But I do see evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/comp_PE_Prod0/bh_ks_pos/html/Comparison_All.html) <br> <br> Archisman: same question as Anuradha above. Also prod 4 seems to be an aligned spin run. Something rails against the mtot bound, but it is not clear what. Also it seems to slightly fall off near the bound, doesn't it? <br> <br> Archisman: Thanks the comparison page seems fixed! Both the PE and the SIQM run neem to be railing against the prior, but on closer inspection, it seems more likely that the posterior falls off just near the prior edge. The behavior is clearer on the source frame plot. I am happy to sign this off -- are the other reviewers fine with it? <br> <br> mtot prior goes down to 20 but samples only go down to 22-ish; so fine! <br> Anuradha: Looks good. **SIGNED OFF!** | <br> Krishnendu: <br>  <br> Not sure if we need a rerun for this event or not. <br> Base config is the Prod0 ini and there are [no open issues](https://git.ligo.org/search?utf8=%E2%9C%93&snippets=&scope=issues&repository_ref=&search=S190707q&project_id=3816&button=) with this event <br>[bh-comparison page with the Prod results](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/comp_PE_Prod0_cbcBayesCompPos/bh_bh/) <br><br> Issues regarding the comparison pages are fixed now. <br> Krishnendu: Not hitting the prior boundary [mtotal](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/pos/ks/1246527224.18-0/H1L1/1Dpdf/mtotal.pdf) and [mtotal_source](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/pos/ks/1246527224.18-0/H1L1/1Dpdf/mtotal_source.pdf)|No rerun|