v0.12.0.md

@@ -60,6 +60,44 @@ See sign off from Patricia here: https://git.ligo.org/lscsoft/pesummary/-/merge_
 * https://git.ligo.org/lscsoft/pesummary/-/merge_requests/501
 * https://git.ligo.org/lscsoft/pesummary/-/merge_requests/500
 
+## Review tests
+
+To check that the same webpages are generated when restarting from checkpoint, we run the following. First, we generate webpages without restarting from checkpoint so we have something to compare to:
+
+```bash
+summarypages --webdir /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/original --samples GW150914.hdf5 --gw --multi_process 6 --labels GW150914
+``
+
+The webpages can be seen [here](https://ldas-jobs.ligo.caltech.edu/~charlie.hoy/projects/pesummary_review/v0.12.0/checkpoint/original/home.html).
+
+Next, we run the command:
+
+```bash
+summarypages --webdir /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/restart --samples GW150914.hdf5 --gw --multi_process 6 --labels GW150914
+```
+
+and kill the job half way through the job. We then run the following command:
+
+```bash
+summarypages --webdir /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/restart --restart_from_checkpoint
+```
+
+The output pages can be seen [here](https://ldas-jobs.ligo.caltech.edu/~charlie.hoy/projects/pesummary_review/v0.12.0/checkpoint/restart/home.html). We also compare the metafiles with:
+
+```bash
+summarycompare --webdir /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/comparison --samples /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/original/samples/posterior_samples.h5 /home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/restart/samples/posterior_samples.h5 --verbose
+```
+
+with output:
+
+```bash
+2021-04-23  04:46:13 PESummary INFO    : Command line arguments: Namespace(compare=['posterior_samples'], generate_comparison_page=False, samples=['/home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/original/samples/posterior_samples.h5', '/home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/restart/samples/posterior_samples.h5'], verbose=False, webdir='/home/charlie.hoy/public_html/projects/pesummary_review/v0.12.0/checkpoint/comparison')
+2021-04-23  04:46:14 PESummary WARNING : Could not find reference_frequency in input file. Using 20Hz as default
+2021-04-23  04:46:15 PESummary WARNING : Could not find reference_frequency in input file. Using 20Hz as default
+```
+
+Indicating that the two metafiles are the same.
+
 ## Reviewer comments