O3a-Spin-Quadrupole-BH-mimicker-test-results/o3a-review-report.md

@@ -19,7 +19,7 @@
 |9.|[GW190720a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190720a)<br> person responsible: Krishnendu| Prod0 seems OK. Should we check with PE if L1 flow is finally 20 and not 40 Hz? <br><br> Krishnendu: fixed. [reply PE channel](https://chat.ligo.org/ligo/channels/parameter-estimation/1bypq6rnmpngtjetm8ssw17t3e) <br><br> Archisman: OK. |Anuradha: <br> why t0, cos(alpha), azimuth are different in all the 3 cases from prod run? <br> BBH: The **ACF** for tc, t0, theta_JN, cos(alpha), azimuth, delta, DL, iota look suspicious. <br> pos: The **ACF** for azimuth look suspicious. <br> The **ACF** for cos(alpha), azimuth, a1, cos(theta1) look suspicious. <br><br> <br> Krishnendu: [BH comparison pages](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_prod_c01/psd_rerun/cbcBayesCompos/comp_bh/) looks fine for me, for example [theta_JN](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/psd_rerun/comp_PE_Prod0/bh_bh/plots/combined_1d_posterior_theta_jn.png) <br> Not sure if we need reruns for ACF issues <br><br> Archisman: So mtot railing. SIQM OK. sym 4 chains; chain 4 may be problematic. pos only 1 chain! **SIGNED OFF** | ||Yes, reruns finished and results are uploaded|
 |10.|[GW190728a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190728q)<br> person responsible: Saleem| Prod0 OK. | Anuradha: LogL is a bit different in BBH case. Otherwise looks good. **SIGNED OFF!** <br><br> Archisman: sym mtot bimodal; no railing. SIQM only negative; pos consistent with sym. sym 2 chains; sampling non-identical regions. pos only 1 chain. **NOT OK** |The runs already have high specs like srate = 2048, nlive = 2048, maxmcmc = 10000, nparallel = 8. Chains broken due to calibration files removed. Resubmitted the dag (16/7/20). If not resumed, will start reruns.||PSD affected. Results uploaded and reviewed|
 |11.|[GW190814a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190814bv) <br> person responsible: Krishnendu| Archisman: base config file info not available. <br><br> Krishnendu: fixed. <br><br> Archisman: Abhirup, could you please check the base config for this event? |Anuradha: Why t0, azimuth and cos(alpha) are different from Prod run in all the 3 cases? In 'result summary' ks_pos has the link of ks_sym, **please fix.** <br><br> Krishnendu: fixed. <br><br> Anuradha: In pos run, **ACF** for all the spin parameters, all the mass parameters, alpha, delta, tc, iota, azimuth look suspicious. <br><br> Archisman: PE comparison t0, cosalph, and azimuth are different. Mtot bimodal for pos. SIQM mostly neg. sym 4 chains (1 chain very short) OK. pos 2 chains sampling different regions. **NOT OK** |Reruns started ||Yes, reruns finished and results are uploaded|
-|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem| Archisman: Mass priors have been increased between Prod0 and Prod5, but no railing with SIQM settings. OK. |Anuradha: LogL is a bit different in BBH case. Which might be okay. **ACFs** for time, iota, ra, dec, and theta_JN are suspicious in the 3 runs. <br><br> Archisman: No mtot railing. SIQM OK. sim 4 chains OK. pos 4 chains OK. **SIGNED OFF!**| ||Yes, PSD reruns finished and  reviewed.|
+|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) <br> person responsible: Saleem| Archisman: Mass priors have been increased between Prod0 and Prod5, but no railing with SIQM settings. OK. |Anuradha: LogL is a bit different in BBH case. Which might be okay. **ACFs** for time, iota, ra, dec, and theta_JN are suspicious in the 3 runs. **SIGNED OFF!** <br><br> Archisman: No mtot railing. SIQM OK. sim 4 chains OK. pos 4 chains OK. **SIGNED OFF!**| ||Yes, PSD reruns finished and  reviewed.|
 |13.|[GW190828b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828l) <br> person responsible: Saleem| Prod4 OK. **Configs and diffs not found!** <br> Saleem: **Link to configs and diffs have been fixed (16/7/20)** | Anuradha:<br>BBH: Awaiting results. <br> pos/sym: **ACF** for time, ra, dec, DL are suspicious. <br><br> Archisman: No mtot railing. SIQM samples mostly neg; pos consistent with sym. sym 4 chains OK; chain 2 may be a bit dirty. pos 4 chains OK; chains 2 & 3 may be a bit dirty. **SIGNED OFF!** |||Yes, Reruns finished for ks_pos and ks_sym whose results are ready to be reviewed. BBH runs failed and reruns started (14/7/2020)|
 |14.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)<br> person responsible: Saleem| Prod0/5 OK. | Anuradha: There were no PSD_reruns for this event and I have signed off on the results from the existing runs (see table below). **ACF:** For BBH run the phase, theta2 and S2z and for sym run, the phase and Theta_JN look weird to me.| Saleem: Reruns started with robust settings (16/7/20) ||No, Results are uploaded from the previous set of runs|