Skip to content

Changes

Page history
Update o3a review report authored by NV Krishnendu's avatar NV Krishnendu
Show whitespace changes
Inline Side-by-side
O3a-Spin-Quadrupole-BH-mimicker-test-results/o3a-review-report.md
View page @ ccf38ccf
...@@ -6,11 +6,11 @@ ...@@ -6,11 +6,11 @@
|4.|[GW190512b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190512at)||<br> <br> Anuradha: BBH: Why log L is different? <br> <br> Archisman: whys is t0 different? Is the BH run used for comparison a non-spinning run?| <br> Krishnendu <br> Yes, this is now being addressed <br> (assume this is the right file to use)| |4.|[GW190512b](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190512at)||<br> <br> Anuradha: BBH: Why log L is different? <br> <br> Archisman: whys is t0 different? Is the BH run used for comparison a non-spinning run?| <br> Krishnendu <br> Yes, this is now being addressed <br> (assume this is the right file to use)|
|5.|[GW190521r](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190412m) || <br>Anuradha:<br> BBH: Why log L is different? <br> ks_pos: Why log L is different? q is shifted toward lower side. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Why log L is different? 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: Spins and spin angles are different (expected). Looks good. || |5.|[GW190521r](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190412m) || <br>Anuradha:<br> BBH: Why log L is different? <br> ks_pos: Why log L is different? q is shifted toward lower side. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Why log L is different? 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: Spins and spin angles are different (expected). Looks good. ||
|6.|[GW190630a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190630ag)||<br>Anuradha: <br>BBH: Why is log L different? <br> ks_pos: Why is log L different? a1, a2 and chi_eff are less constrained. <br> Why is log L different? <br> <br> Archisman: where are the comparison pages? I could not find them. |<br> Krishnendu <br> <br> Please see this page for [PE results](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/) are the comparison page with PE Prod runs| |6.|[GW190630a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190630ag)||<br>Anuradha: <br>BBH: Why is log L different? <br> ks_pos: Why is log L different? a1, a2 and chi_eff are less constrained. <br> Why is log L different? <br> <br> Archisman: where are the comparison pages? I could not find them. |<br> Krishnendu <br> <br> Please see this page for [PE results](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190630ag/pv2_c01_prod/comp_PE_Prod0/) are the comparison page with PE Prod runs|
|7.|[GW190707a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190707q)||<br> Anuradha: All the comparison pages have 'Prod0' vs 'Prod4' legends, so I am not sure if I am looking are correct plots. But I do see evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/comp_PE_Prod0/bh_ks_pos/html/Comparison_All.html) <br> <br> Archisman: same question as Anuradha above. Also prod 4 seems to be an aligned spin run. Something rails against the mtot bound, but it is not clear what. Also it seems to slightly fall off near the bound, doesn't it? | <br> Krishnendu: <br> There is something wrong with the comparison page. <br> Currently being rerun| |7.|[GW190707a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190707q)||<br> Anuradha: All the comparison pages have 'Prod0' vs 'Prod4' legends, so I am not sure if I am looking are correct plots. But I do see evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190707q/pv2_c01_prod/comp_PE_Prod0/bh_ks_pos/html/Comparison_All.html) <br> <br> Archisman: same question as Anuradha above. Also prod 4 seems to be an aligned spin run. Something rails against the mtot bound, but it is not clear what. Also it seems to slightly fall off near the bound, doesn't it? | <br> Krishnendu: <br> There is something wrong with the comparison page. <br> Currently being rerun and please see the nedited wiki|
|8.|[GW190708a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190708ap) ||<br> Anuradha: <br> BBH: Why log L, a1, a1z, and a2z are different? <br>ks_pos: a1z, and a2z are different. a1, a2 are totally unconstrained. 1D ks plot is missing on the posplots.html page. <br> ks_sym: a1z, a2z, a1, a2 are unconstrained. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: spins are significantly different. Why are spins estimated better for the SIQM run than for the PE run? Otherwise fine. In particular, no mtot railing. || |8.|[GW190708a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190708ap) ||<br> Anuradha: <br> BBH: Why log L, a1, a1z, and a2z are different? <br>ks_pos: a1z, and a2z are different. a1, a2 are totally unconstrained. 1D ks plot is missing on the posplots.html page. <br> ks_sym: a1z, a2z, a1, a2 are unconstrained. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: spins are significantly different. Why are spins estimated better for the SIQM run than for the PE run? Otherwise fine. In particular, no mtot railing. ||
|9.|[GW190720a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190720a)||<br> Anuradha: There is one comparison page given, the label says 'BH comparison page' but when you go inside it has BH and ks_sym legends. So, I am not sure what am I looking at. Since there are no comparison plots, I am not sure if the results are alright. <br> There are evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_prod_c01/comp_ks_bh/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/sym/ks/1247616534.7-0/V1H1L1/posplots.html) <br> <br> Archisman: Spins and spin angles are different (expected). Why is chirp mass so different? There is a minor railing of mtot against the prior. || |9.|[GW190720a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190720a)||<br> Anuradha: There is one comparison page given, the label says 'BH comparison page' but when you go inside it has BH and ks_sym legends. So, I am not sure what am I looking at. Since there are no comparison plots, I am not sure if the results are alright. <br> There are evidence for Mtot posterior trailing [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_prod_c01/comp_ks_bh/) and [here](https://ldas-jobs.ligo.caltech.edu/~nv.krishnendu/LSC/lalinference/O3/o3_a_tgr/S190720a/pv2_c01_prod/sym/ks/1247616534.7-0/V1H1L1/posplots.html) <br> <br> Archisman: Spins and spin angles are different (expected). Why is chirp mass so different? There is a minor railing of mtot against the prior. ||
|10.|[GW190728a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190728q)|| Archisman: still running || |10.|[GW190728a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190728q)|| Archisman: still running ||
|11.|[GW190814a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190814bv) ||<br>Anuradha: No plots, comparison or otherwise, to look at. <br> <br> Archisman: where are the comparison pages? || |11.|[GW190814a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190814bv) ||<br>Anuradha: No plots, comparison or otherwise, to look at. <br> <br> Archisman: where are the comparison pages? |Please see the updated wiki page|
|12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) ||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. || |12.|[GW190828a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190828j) ||<br> Anuradha: BBH: All parameters are different. You BBH runs is actually better. Prod results are bad, why? <br> ks_pos: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. <br> ks_sym: Since Prod results are bad, I can not compare. 1D ks plot is missing on the posplots.html page. ||
|13.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)||<br> Anuradha: <br> BBH: m1 and mtotal are railing at the boundary. <br>ks_pos: I hope it is a typo, it says BBH vs PE run. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> ks_sym: mtotal is railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: is the PE run used for comparison a production PE run? PE run seems to have very restrictive distance priors. Why is everything estimated better for the SIQM run then for the PE run? PE run shows mtot railing. SIQM run shows a very marginal mtot railing. || |13.|[GW190924a](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/S190924h)||<br> Anuradha: <br> BBH: m1 and mtotal are railing at the boundary. <br>ks_pos: I hope it is a typo, it says BBH vs PE run. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> ks_sym: mtotal is railing at the boundary. 1D ks plot is missing on the posplots.html page. <br> <br> Archisman: is the PE run used for comparison a production PE run? PE run seems to have very restrictive distance priors. Why is everything estimated better for the SIQM run then for the PE run? PE run shows mtot railing. SIQM run shows a very marginal mtot railing. ||
...@@ -19,8 +19,8 @@ ...@@ -19,8 +19,8 @@
|No.| NAME | Comments on config ini file|Comments on results | Reviewees comments | |No.| NAME | Comments on config ini file|Comments on results | Reviewees comments |
|---| ---- | ---- | ---- | --- | |---| ---- | ---- | ---- | --- |
|1. |[GW150914](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW150914) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why is log L different? why a1 and a2 are oppositely unconstrained? Why is optimal (or matched-filter) SNR so different than BBH case?|| |1. |[GW150914](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW150914) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why is log L different? why a1 and a2 are oppositely unconstrained? Why is optimal (or matched-filter) SNR so different than BBH case?|<br>Krishnendu: Comparison pages added now|
|2. |[GW151226](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW151226) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why is log L very very different? why a1 and a2 are totally unconstrained? Why is optimal (or matched-filter) SNR so different than BBH case? Mc, Mtot and m1 are railing at the boundary.|| |2. |[GW151226](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW151226) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why is log L very very different? why a1 and a2 are totally unconstrained? Why is optimal (or matched-filter) SNR so different than BBH case? Mc, Mtot and m1 are railing at the boundary.|<br>Krishnendu: Comparison pages added now|
|3. |[GW170104](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170104) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots. <br> ks_pos: Why is log L different? Why a1 and a2 are totally unconstrained? <br> ks_sym: DL and q go beyond prior limits. Why Mc is so different?|| |3. |[GW170104](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170104) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots. <br> ks_pos: Why is log L different? Why a1 and a2 are totally unconstrained? <br> ks_sym: DL and q go beyond prior limits. Why Mc is so different?|<br>Krishnendu: Comparison pages added now|
|4. |[GW170608](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170608) | |<br> Anuradha: <br> BBH: Why log L is different? <br>ks_pos: Why log L is different? a2 is unconstrained. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br>ks_sym: Why log L is different? a2 is unconstrained. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page.|| |4. |[GW170608](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170608) | |<br> Anuradha: <br> BBH: Why log L is different? <br>ks_pos: Why log L is different? a2 is unconstrained. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page. <br>ks_sym: Why log L is different? a2 is unconstrained. m1, m2 and mtotal are railing at the boundary. 1D ks plot is missing on the posplots.html page.||
|5. |[GW170814](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170814) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why a1 and a2 are totally unconstrained?|| |5. |[GW170814](https://git.ligo.org/nv.krishnendu/lalsuite/-/wikis/O3a-Spin-Quadrupole-BH-mimicker-test-results/GW170814) | |<br>Anuradha: No comparison-with-prod-run-plots, no ks plots.<br> ks_pos/ks_sym: Why a1 and a2 are totally unconstrained?|<br>Krishnendu: Comparison pages added now|