O3a-Spin-Quadrupole-BH-mimicker-test-results/o3a-review-report.md

@@ -36,7 +36,7 @@
 |9.|[GW190720a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190720a)<br> person responsible: Krishnendu||<br> Anuradha: There is one comparison page given, the label says 'BH comparison page' but when you go inside it has BH and ks_sym legends. So, I am not sure what am I looking at. Since there are no comparison plots, I am not sure if the results are alright. <br> There are evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_prod_c01/comp_ks_bh/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/sym/ks/1247616534.7-0/V1H1L1/posplots.html) <br> <br> Archisman: Spins and spin angles are different (expected). Why is chirp mass so different? There is a minor railing of mtot against the prior. <br> <br> Archisman: This looks fine to me now. Chirp mass is fine. No mtot railing. <br> <br> Archisman: mtot prior goes down to 20 while samples go down to only about 23. **Krishnendu**, why do you want to rerun this? <br> Anuradha: looks good. **SIGNED OFF!**|<br> <br> Posteriors not hitting the prior boundary[mtotal_det](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/sym/ks/1247616534.7-0/V1H1L1/1Dpdf/mtotal.pdf) <bt> [mtotal_source](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/sym/ks/1247616534.7-0/V1H1L1/1Dpdf/mtotal_source.pdf) <br> After discussion on 29.05.2020 we decided to have no rerun | **SIGNED OFF!**|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
 |10.|[GW190728a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190728q)<br> person responsible: Saleem|| Anuradha: Log L is a bit different in BH vs Prod case. Please confirm that the Bayes factors are similar. Otherwise looks good. <br><br> Archisman: mtot drops of very fast and close to prior edge, but no railing. SIQM: very good constraint on positive side; weak constraint (flat tail) on negative side. **SIGNED OFF!** <br> Anuradha: **SIGNED OFF!**| The log Bayes factors for [BBH](https://ldas-jobs.ligo.caltech.edu/~muhammed.saleem/LSC/lalinference/O3/S190728q/C01_run2/pv2/bbh/nest/1248331528.529205-0/L1V1H1/pesummary/home.html) and [PE](https://ldas-jobs.ligo.caltech.edu/~eleanor.hamilton/o3/s190728q/PROD0/1248331528.529205-0/L1V1H1/posplots.html) runs are 58.7 and 56.7 respectively |Waiting for comments|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
 |11.|[GW190814a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190814bv) <br> person responsible: Krishnendu||<br>Anuradha: No plots, comparison or otherwise, to look at. <br> <br> Archisman: where are the comparison pages? <br> <br> Archisman: no mtot railing. Looks good. <br> <br> Anuradha: Base config does not look up-to-date. <br> BBH:The comparison is actually with ks_pos. Please fix. <br> ks_pos/ks_sym: ks plots missing.<br><br>Anuradha: **SIGNED OFF!**|Please see the updated wiki page|Waiting|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
-|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: something very incorrect in the comparison pages which I see as of May 29 -- everything is estimated differently. Good that this is being rerun.|Saleem: Rerunning after removing the mtotal priors |Rerun completed and ready to be reviewed|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
+|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: something very incorrect in the comparison pages which I see as of May 29 -- everything is estimated differently. Good that this is being rerun. <br> Anuradha: **SIGNED OFF!**|Saleem: Rerunning after removing the mtotal priors |Rerun completed and ready to be reviewed|<br> Yes, reruns are adviced because of the difference in the estimated PSD for the three runs|
 |13.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)<br> person responsible: Saleem||<br> Anuradha: <br> BBH: m1 and mtotal are railing at the boundary. <br>ks_pos: I hope it is a typo, it says BBH vs PE run. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> ks_sym: mtotal is railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: is the PE run used for comparison a production PE run? PE run seems to have very restrictive distance priors. Why is everything estimated better for the SIQM run then for the PE run? PE run shows mtot railing. SIQM run shows a very marginal mtot railing. <br><br> Anuradha: looks good. **SIGNED OFF** <br><br> Archisman: mtot falls of very fast to the left of the peak, but no railing. SIQM typical, but seems ragged; more samples might help. **SIGNED OFF!** | Saleem: The results are now updated with the latest runs. earlier runs used an older lalsuite installation. The results are not expected to be different. The typos in labels are fixed and posteriors are now made from more number of samples. From manually plotting the posteriors, there is no railing against prior for Mtotal. Also, no Mtot prior is imposed in the config for this event. <br> <br> Please see if there is an issue of insufficient sampling |Ready to be reviewed|<br> Not affected by the PSD difference|
 
 ### Table 2: List of events from O1 and O2