Changes

Page history
Update O4 Review authored by Simon Stevenson's avatar Simon Stevenson
Hide whitespace changes
Inline Side-by-side
O4-Review.md
View page @ d1b831eb
...@@ -2,17 +2,19 @@ ...@@ -2,17 +2,19 @@
### Reviewees ### Reviewees
@avi.vajpeyi @avi.vajpeyi
@rory-smith @rory-smith
### Reviewers ### Reviewers
@simon-stevenson @simon-stevenson
### Review statement ### Review statement
tbc Parallel Bilby (pBilby) provides the infrastructure to use Bilby in a parallel computing setting. The review here follows the [Sampler Review Specification](https://docs.google.com/document/d/1kJAV_Q7gK03wNnEb3E5Juz3-Uiuh0R6yScgmzMGH3C0/edit#heading=h.3tjq4cvchjje). All results pass the review. The PP tests are unbiased, and the runs on real events are statistically identical to those produced previously for GWTC-3. For GW191109 (a prior dominated event), the differences between the recent rerun and the catalog are larger, [consistent with the main Bilby review](https://git.ligo.org/pe/O4/bilby_o4_review/-/issues/31). In addition, scaling tests and energy usage statistics are presented.
\-- Simon Stevenson 8th May 2023
### Details ### Details
...@@ -41,15 +43,15 @@ tbc ...@@ -41,15 +43,15 @@ tbc
| Task | Assigned | Analysed? | Reviewed? | | Task | Assigned | Analysed? | Reviewed? |
|------|----------|-----------|-----------| |------|----------|-----------|-----------|
| [GW150914](#gw150914) | Avi | ✓ | :white_check_mark: @simon-stevenson | | [GW150914](#gw150914) | Avi | ✓ | :white_check_mark: @simon-stevenson |
| [GW190425](#gw190425) | Rory | ✓ | :white_check_mark: [@simon-stevenson](#) | | [GW190425](#gw190425) | Rory | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [GW191109](#gw191109) | Rory | ✓ | | | [GW191109](#gw191109) | Rory | ✓ | see review statement |
| [GW200208](#gw200208) | Rory | ✓ | | | [GW200208](#gw200208) | Rory | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [Fiducial BBH Inj](#fiducial-bbh-inj) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) | | [Fiducial BBH Inj](#fiducial-bbh-inj) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [Scaling test](#scaling-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) | | [Scaling test](#scaling-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [4s BBH PP-test](#4s-bbh-pp-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) | | [4s BBH PP-test](#4s-bbh-pp-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [16s BBH PP-test](#16s-bbh-pp-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) | | [16s BBH PP-test](#16s-bbh-pp-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [64s NSBH PP-test](#64s-bbh-pp-test) | Avi | ✓ | | | [64s NSBH PP-test](#64s-bbh-pp-test) | Avi | ✓ | :white_check_mark: [@simon-stevenson](#) |
| [128s BNS (ROQ) PP-test](#128s-bns-pp-test) | Rory | ✓ | :white_check_mark: [@simon-stevenson](#) | | [128s BNS (ROQ) PP-test](#128s-bns-pp-test) | Rory | ✓ | :white_check_mark: [@simon-stevenson](#) |
[Energy usage statement](#energycarbon-footprint-of-review) [Energy usage statement](#energycarbon-footprint-of-review)
...@@ -153,8 +155,7 @@ Note: the JS-Divergence values are median +- std values obtained with bootstrapp ...@@ -153,8 +155,7 @@ Note: the JS-Divergence values are median +- std values obtained with bootstrapp
<details> <details>
<summary>Configs Contents</summary> <summary>Configs Contents</summary>
RORY TO PUSH HIS CHANGED CONFIGS RORY TO PUSH HIS CHANGED CONFIGS [Link to config](https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/blob/main/GW190425/config_pbilby.ini)
[Link to config](https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/blob/main/GW190425/config_pbilby.ini)
```ini ```ini
RORY TO PASTE UPDATED CONTENTS RORY TO PASTE UPDATED CONTENTS
...@@ -162,7 +163,6 @@ RORY TO PASTE UPDATED CONTENTS ...@@ -162,7 +163,6 @@ RORY TO PASTE UPDATED CONTENTS
</details> </details>
<details> <details>
<summary>Results</summary> <summary>Results</summary>
...@@ -193,7 +193,9 @@ RORY TO PASTE UPDATED CONTENTS ...@@ -193,7 +193,9 @@ RORY TO PASTE UPDATED CONTENTS
## GW191109 ## GW191109
<details><summary>Configs</summary> <details>
<summary>Configs</summary>
https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/tree/main/GW191109 https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/tree/main/GW191109
```python ```python
...@@ -218,7 +220,6 @@ recalib_H1_amplitude_0 = Gaussian(mu=-0.009695320217683778, sigma=0.028499697803 ...@@ -218,7 +220,6 @@ recalib_H1_amplitude_0 = Gaussian(mu=-0.009695320217683778, sigma=0.028499697803
... ...
recalib_L1_frequency_9 = DeltaFunction(peak=447.9999999999999, name='recalib_L1_frequency_9', latex_label='$f^L1_9$', unit=None) recalib_L1_frequency_9 = DeltaFunction(peak=447.9999999999999, name='recalib_L1_frequency_9', latex_label='$f^L1_9$', unit=None)
time_jitter = Uniform(minimum=-0.0009765625, maximum=0.0009765625, name=None, latex_label=None, unit=None, boundary='periodic') time_jitter = Uniform(minimum=-0.0009765625, maximum=0.0009765625, name=None, latex_label=None, unit=None, boundary='periodic')
``` ```
``` ```
...@@ -414,54 +415,44 @@ mode-array=[None] ...@@ -414,54 +415,44 @@ mode-array=[None]
frequency-domain-source-model=lal_binary_black_hole frequency-domain-source-model=lal_binary_black_hole
conversion-function=None conversion-function=None
generation-function=None generation-function=None
``` ```
</details> </details>
<details><summary>Results</summary> <details>
<summary>Results</summary>
| | JS Divergence | | | JS Divergence |
|:--------------------|:--------------------| |--|---------------|
| mass_2 | 0.00911 +/- 0.00030 | | mass_2 | 0.00911 +/- 0.00030 |
| a_1 | 0.01848 +/- 0.00020 | | a_1 | 0.01848 +/- 0.00020 |
| chirp_mass | 0.01426 +/- 0.00030 | | chirp_mass | 0.01426 +/- 0.00030 |
| cos_tilt_1 | 0.01145 +/- 0.00030 | | cos_tilt_1 | 0.01145 +/- 0.00030 |
| luminosity_distance | 0.00319 +/- 0.00013 | | luminosity_distance | 0.00319 +/- 0.00013 |
| dec | 0.00553 +/- 0.00019 | | dec | 0.00553 +/- 0.00019 |
| mass_1 | 0.00578 +/- 0.00024 | | mass_1 | 0.00578 +/- 0.00024 |
| ra | 0.00530 +/- 0.00018 | | ra | 0.00530 +/- 0.00018 |
| mass_ratio | 0.00417 +/- 0.00019 | | mass_ratio | 0.00417 +/- 0.00019 |
| a_2 | 0.00643 +/- 0.00018 | | a_2 | 0.00643 +/- 0.00018 |
| chi_eff | 0.02236 +/- 0.00040 | | chi_eff | 0.02236 +/- 0.00040 |
| cos_tilt_2 | 0.00189 +/- 0.00012 | | cos_tilt_2 | 0.00189 +/- 0.00012 |
| | | |
|--| |--|
| ![GW191109_effective_spin]{width="400"} | | ![GW191109_effective_spin](uploads/1d52b01913b106406f85f6e6db557529/GW191109_effective_spin.png){width="400"} |
| ![GW191109_mass]{width="400"} | | ![GW191109_mass](uploads/0e6a875b2a63ce419a81141dc466512c/GW191109_mass.png){width="400"} |
| ![GW191109_skypos]{width="400"} | | ![GW191109_skypos](uploads/6e1b421c9b0b97a873a955f508c10912/GW191109_skypos.png){width="400"} |
| ![GW191109_spin]{width="400"} | | ![GW191109_spin](uploads/af2e61994d0d19f7fb5245cbe2373d35/GW191109_spin.png){width="400"} |
[GW191109_effective_spin]:uploads/1d52b01913b106406f85f6e6db557529/GW191109_effective_spin.png
[GW191109_mass]:uploads/0e6a875b2a63ce419a81141dc466512c/GW191109_mass.png
[GW191109_skypos]:uploads/6e1b421c9b0b97a873a955f508c10912/GW191109_skypos.png
[GW191109_spin]:uploads/af2e61994d0d19f7fb5245cbe2373d35/GW191109_spin.png
</details> </details>
## GW200208 ## GW200208
<details> <details>
<summary>Configs Contents</summary> <summary>Configs Contents</summary>
RORY TO PUSH HIS CHANGED CONFIGS RORY TO PUSH HIS CHANGED CONFIGS [Link to config](https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/blob/main/GW200208)
[Link to config](https://git.ligo.org/avi.vajpeyi/pbilby_o4_review/-/blob/main/GW200208)
```ini ```ini
RORY TO PASTE UPDATED CONTENTS RORY TO PASTE UPDATED CONTENTS
...@@ -469,7 +460,6 @@ RORY TO PASTE UPDATED CONTENTS ...@@ -469,7 +460,6 @@ RORY TO PASTE UPDATED CONTENTS
</details> </details>
<details> <details>
<summary>Results</summary> <summary>Results</summary>
...@@ -696,12 +686,8 @@ theta_jn = Sine(minimum=0, maximum=3.141592653589793, name='theta_jn', latex_lab ...@@ -696,12 +686,8 @@ theta_jn = Sine(minimum=0, maximum=3.141592653589793, name='theta_jn', latex_lab
psi = Uniform(minimum=0, maximum=3.141592653589793, name='psi', latex_label='$\\psi$', unit=None, boundary='periodic') psi = Uniform(minimum=0, maximum=3.141592653589793, name='psi', latex_label='$\\psi$', unit=None, boundary='periodic')
phase = Uniform(minimum=0, maximum=6.283185307179586, name='phase', latex_label='$\\phi$', unit=None, boundary='periodic') phase = Uniform(minimum=0, maximum=6.283185307179586, name='phase', latex_label='$\\phi$', unit=None, boundary='periodic')
geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, unit=None, boundary=None) geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, unit=None, boundary=None)
``` ```
</details> </details>
## 64s NSBH PP Test ## 64s NSBH PP Test
...@@ -710,8 +696,6 @@ geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, u ...@@ -710,8 +696,6 @@ geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, u
|------|-----------------| |------|-----------------|
| ![](uploads/b1ed801e2a0f160c32f903e0676c4aee/pp.png){width="400"} | chi_1: 0.4992570685752896<br>geocent_time: 0.4118885681025427<br>phase: 0.6634869180692597<br>chi_2: 0.3105329024763821<br>lambda_2: 0.6907419728614335<br>mass_ratio: 0.6051768877327064<br>psi: 0.7338633517667341<br>ra: 0.3135131771725553<br>chirp_mass: 0.6931812756564575<br>dec: 0.12489457715012901<br>theta_jn: 0.260318149984087<br>luminosity_distance: 0.1516897714046811<br>Combined p-value: 0.5576180592517699 | | ![](uploads/b1ed801e2a0f160c32f903e0676c4aee/pp.png){width="400"} | chi_1: 0.4992570685752896<br>geocent_time: 0.4118885681025427<br>phase: 0.6634869180692597<br>chi_2: 0.3105329024763821<br>lambda_2: 0.6907419728614335<br>mass_ratio: 0.6051768877327064<br>psi: 0.7338633517667341<br>ra: 0.3135131771725553<br>chirp_mass: 0.6931812756564575<br>dec: 0.12489457715012901<br>theta_jn: 0.260318149984087<br>luminosity_distance: 0.1516897714046811<br>Combined p-value: 0.5576180592517699 |
<details> <details>
<summary>Configs Contents</summary> <summary>Configs Contents</summary>
...@@ -793,10 +777,10 @@ geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, u ...@@ -793,10 +777,10 @@ geocent_time = Uniform(minimum=-0.1, maximum=0.1, name=None, latex_label=None, u
| 128s BNS PP | | | | | 128s BNS PP | | | |
| Failed/Test runs | | 12973.4 | 3502.8 | | Failed/Test runs | | 12973.4 | 3502.8 |
**Total CO2: \~8 tCO2** **Total CO2: <span dir="">\~</span>8 tCO2**
For the capture of 1 tonne of CO2 emissions \~50 trees must grow for one year \[[1](https://www.climateneutralgroup.com/en/news/what-exactly-is-1-tonne-of-co2/)\] For the capture of 1 tonne of CO2 emissions <span dir="">\~</span>50 trees must grow for one year \[[1](https://www.climateneutralgroup.com/en/news/what-exactly-is-1-tonne-of-co2/)\]
^using 0.905 kg of CO2 per kilowatt hour \[[2](http://www.environment.gov.au/climate-change/climate-science-data/greenhouse-gas-measurement/publications/national-greenhouse-accounts-factors-july-2018)\], and 0.3kWh/hr per CPU. ^using 0.905 kg of CO2 per kilowatt hour \[[2](http://www.environment.gov.au/climate-change/climate-science-data/greenhouse-gas-measurement/publications/national-greenhouse-accounts-factors-july-2018)\], and 0.3kWh/hr per CPU.
Failed/Test runs include 1 GW150914 run, 2 GW170817 runs (w + w/o ROQ), 1 biased BBH pp test. Failed/Test runs include 1 GW150914 run, 2 GW170817 runs (w + w/o ROQ), 1 biased BBH pp test.
\ No newline at end of file