gwcelery issueshttps://git.ligo.org/emfollow/gwcelery/-/issues2024-03-23T00:10:23Zhttps://git.ligo.org/emfollow/gwcelery/-/issues/784Release Version 2.3.2 "Champ"2024-03-23T00:10:23ZCody MessickRelease Version 2.3.2 "Champ"**Git ref**: 5a4b9417b4a24f22c891d486b6fc3ae015e933de
# Checklist
Skipping checklist as this release is identical to 2.3.1, except public alerts have been enabled. See #783 for acceptance checks.**Git ref**: 5a4b9417b4a24f22c891d486b6fc3ae015e933de
# Checklist
Skipping checklist as this release is identical to 2.3.1, except public alerts have been enabled. See #783 for acceptance checks.https://git.ligo.org/emfollow/gwcelery/-/issues/783Release Version 2.3.1 "Champ"2024-03-23T00:05:38ZCody MessickRelease Version 2.3.1 "Champ"**Git ref**: 8b472edc0c9e4dafc36914677a47fa1989634087
# Checklist
## Basics
1. [x] The CI pipeline succeeded, including all unit tests and code quality checks. https://git.ligo.org/emfollow/gwcelery/-/pipelines/610547
2. [x] [CHANGE...**Git ref**: 8b472edc0c9e4dafc36914677a47fa1989634087
# Checklist
## Basics
1. [x] The CI pipeline succeeded, including all unit tests and code quality checks. https://git.ligo.org/emfollow/gwcelery/-/pipelines/610547
2. [x] [CHANGES.rst](https://git.ligo.org/emfollow/gwcelery/-/blob/release/v2.3/CHANGES.rst) lists all significant changes since the last release. It is free from spelling and grammatical errors.
3. [x] The [latest Readthedocs documentation build](https://readthedocs.org/projects/gwcelery/builds/) passed and the [latest branch docs](https://rtd.igwn.org/projects/gwcelery/en/release-v2.3) are correctly rendered. Autodoc-generated API docs for tasks are shown.
4. [x] If there is [milestone](https://git.ligo.org/emfollow/gwcelery/-/milestones) for this
release, then the list of issues and merge requests that have been
addressed is accurate. Any unaddressed issues and merge requests have been
moved to another milestone.
5. [x] Check the versions of the following packages in the [`poetry.lock`](https://git.ligo.org/emfollow/gwcelery/-/blob/release/v2.3/poetry.lock) file have been approved by the SCCB (i.e. either has the status:deploy or status:deployed label).
- [x] [`bilby`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=bilby&first_page_size=100)
- [x] [`bilby_pipe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=bilby_pipe&first_page_size=100)
- [x] [`gracedb-sdk`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gracedb-sdk&first_page_size=100)
- [x] [`gwdatafind`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwdatafind&first_page_size=100)
- [x] [`gwpy`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwpy&first_page_size=100)
- [x] [`gwskynet`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwskynet&first_page_size=100)
- [x] [`igwn-alert`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=igwn-alert&first_page_size=100)
- [x] [`igwn-gwalert-schema`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=igwn-gwalert-schema&first_page_size=20)
- [x] [`lalsuite`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=lalsuite&first_page_size=100)
- [x] [`ligo-followup-advocate`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-followup-advocate&first_page_size=100)
- [x] [`ligo-gracedb`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-gracedb&first_page_size=100)
- [x] [`ligo-raven`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-raven&first_page_size=100)
- [x] [`ligo-segments`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-segments&first_page_size=20)
- [x] [`ligo.em-bright`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo.em-bright&first_page_size=20)
- [x] [`ligo.skymap`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo.skymap&first_page_size=100)
- [x] [`lscsoft-glue`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=lscsoft-glue&first_page_size=100)
- [x] [`pesummary`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=pesummary&first_page_size=100)
- [x] [`python-ligo-lw`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=python-ligo-lw&first_page_size=100)
- [x] [`rapidpe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=Rapidpe&first_page_size=20)
- [x] [`rapidpe-rift-pipe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=RapidPE%20pipeline&first_page_size=20)
- [x] [`RIFT`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=rift&first_page_size=100)
## Test deployment
4. [x] Sentry does not show any new [unresolved issues on ~~test~~playground](https://sentry.io/organizations/ligo-caltech/issues/?environment=playground&groupStatsPeriod=14d&project=1425216&query=is%3Aunresolved&statsPeriod=14d) that indicate new bugs or regressions.
5. [x] The ~~test~~playground deployment has run for at least 10 minutes.
6. [x] The [Flower monitor](https://emfollow-playground.ligo.caltech.edu/flower) is reachable and shows no unexpected task failures.
7. [x] The [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) is reachable.
8. [x] The ~~test~~playground deployment is [connected to IGWN Alert](https://emfollow-playground.ligo.caltech.edu/flower/worker/gwcelery-worker%40emfollow-playground.ligo.caltech.edu#tab-other) (in Flower, find the main gwcelery-worker, click Other, and look at the list of subscribed IGWN Alert topics).
9. [x] The ~~test~~playground deployment is [connected to GCN](https://emfollow-playground.ligo.caltech.edu/flower/worker/gwcelery-voevent-worker%40emfollow-playground.ligo.caltech.edu#tab-other) (in Flower, find the voevent gwcelery-worker, click Other, and look at the list of receiver peers).
## Mock events
10. [x] The ~~test~~playground deployment has [produced an MDC superevent](https://gracedb-playground.ligo.org/latest/?query=MDC&query_type=S).
11. [x] The MDC superevent has the following annotations.
- [x] `bayestar.multiorder.fits`
- [x] `bayestar.fits.gz`
- [x] `bayestar.png`
- [x] `bayestar.volume.png`
- [x] `bayestar.html`
- [x] `p_astro.json`
- [x] `p_astro.png`
- [x] `em_bright.json`
- [x] `em_bright.png`
12. [x] The MDC superevent has the following labels.
- [x] `EMBRIGHT_READY`
- [x] `GCN_PRELIM_SENT`
- [x] `PASTRO_READY`
- [x] `SKYMAP_READY`
13. [x] The MDC superevent has two automatic preliminary VOEvents, JSON packets, and Avro packets if `GCN_PRELIM_SENT` is applied.
- [x] 2 preliminary VOEvents
- [x] 2 preliminary JSON packets
- [x] 2 preliminary Avro packets
14. [x] Issuing a manual preliminary alert from the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) sends another preliminary alert.
- [ ] The alert **is sent** successfully if `ADVOK` or an `ADVNO` label is **not applied** this time.
- [x] Alternatively, a preliminary alert is **blocked** due to presence of `ADVOK` or `ADVNO`.
15. [x] `DQR_REQUEST` label is applied to the superevent. The application happens at the time of launching the second preliminary alert.
16. [x] The MDC superevent has either an `ADVOK` or an `ADVNO` label.
17. [x] Issuing an `ADVOK` signoff through GraceDB results in an initial VOEvent.
18. [x] Issuing an `ADVNO` signoff through GraceDB results in a retraction VOEvent.
19. [x] Requesting an update alert through the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) results in an update VOEvent.
20. [x] ~~Test~~Playground has recently [produced an MDC superevent with an external coincidence](https://gracedb-playground.ligo.org/latest/?query=MDC+EM_COINC&query_type=S), i.e. with an `EM_COINC` label. Use the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) to do this manually (note that joint events with Swift may not pass publishing conditions and or have a combined sky map, indicated by the lack of `RAVEN_ALERT` and `COMBINEDSKYMAP_READY` label respectively).
21. [x] The joint MDC superevent has the following annotations.
- [x] `coincidence_far.json`
- [x] `combined-ext.multiorder.fits` or `combined-ext.fits.gz`
- [x] `combined-ext.png`
- [x] `overlap_integral.png`
22. [x] The joint MDC superevent has the following labels.
- [x] `EM_COINC`
- [x] `RAVEN_ALERT`
- [x] `COMBINEDSKYMAP_READY`
- [x] `GCN_PRELIM_SENT`
23. [x] The joint MDC superevent is sending alerts with coincidence information.
- [x] At least one VOEvent with `<Group name="External Coincidence">`.
- [x] At least one Kafka JSON packet with an `external_coinc` field.
- [x] At least one circular w/ `-emcoinc-` in filename.
24. [x] Issue a manual RAVEN alert using the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) for a coincidence (i.e. has `EM_COINC` label) that has does not have the `RAVEN_ALERT` label yet. Choose a [recent joint coincidence that meets this criteria](https://gracedb-playground.ligo.org/latest/?query=MDC+%7ERAVEN_ALERT+%26+EM_COINC&query_type=S&get_neighbors=&results_format=) and ensure that a `RAVEN_ALERT` label is applied to the associated superevent, external event, and preferred event.
## Replay events
24. [x] [A Production superevent labeled `GCN_PRELIM_SENT`](https://gracedb-playground.ligo.org/latest/?query=Production+GCN_PRELIM_SENT&query_type=S&get_neighbors=&results_format=) has the following parameter estimation annotations and the `PE_READY` label.
- [x] `bilby_config.ini`
- [x] `Bilby.posterior_samples.hdf5`
- [x] `Bilby.multiorder.fits`
- [x] `Bilby.html`
- [x] `Bilby.fits.gz`
- [x] `Bilby.png`
- [x] `Bilby.volume.png`
- [x] `PE_READY`
- [x] Link to PEsummary page (log message in parameter estimation section)https://git.ligo.org/emfollow/gwcelery/-/issues/765Release version 2.2.1 "Sheepsquatch"2024-03-08T22:38:01ZCody MessickRelease version 2.2.1 "Sheepsquatch"**Git ref**: fed9d492bab4ef428bd704579fee773329ed10ce
# Checklist
## Basics
1. [x] The CI pipeline succeeded, including all unit tests and code quality checks. https://git.ligo.org/emfollow/gwcelery/-/pipelines/603703
2. [ ] [CHANGE...**Git ref**: fed9d492bab4ef428bd704579fee773329ed10ce
# Checklist
## Basics
1. [x] The CI pipeline succeeded, including all unit tests and code quality checks. https://git.ligo.org/emfollow/gwcelery/-/pipelines/603703
2. [ ] [CHANGES.rst](https://git.ligo.org/emfollow/gwcelery/-/blob/release/v2.2/CHANGES.rst) lists all significant changes since the last release. It is free from spelling and grammatical errors.
3. [x] The [latest Readthedocs documentation build](https://readthedocs.org/projects/gwcelery/builds/) passed and the [latest branch docs](https://rtd.igwn.org/projects/gwcelery/en/release-v2.2) are correctly rendered. Autodoc-generated API docs for tasks are shown.
4. [x] If there is [milestone](https://git.ligo.org/emfollow/gwcelery/-/milestones) for this
release, then the list of issues and merge requests that have been
addressed is accurate. Any unaddressed issues and merge requests have been
moved to another milestone.
5. [ ] Check the versions of the following packages in the [`poetry.lock`](https://git.ligo.org/emfollow/gwcelery/-/blob/release/v2.2/poetry.lock) file have been approved by the SCCB (i.e. either has the status:deploy or status:deployed label).
- [x] [`bilby`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=bilby&first_page_size=100)
- [x] [`bilby_pipe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=bilby_pipe&first_page_size=100)
- [x] [`gracedb-sdk`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gracedb-sdk&first_page_size=100)
- [x] [`gwdatafind`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwdatafind&first_page_size=100)
- [x] [`gwpy`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwpy&first_page_size=100)
- [ ] [`gwskynet`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=gwskynet&first_page_size=100)
- [x] [`igwn-alert`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=igwn-alert&first_page_size=100)
- [x] [`igwn-gwalert-schema`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=igwn-gwalert-schema&first_page_size=20)
- [x] [`lalsuite`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=lalsuite&first_page_size=100)
- [x] [`ligo-followup-advocate`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-followup-advocate&first_page_size=100)
- [x] [`ligo-gracedb`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-gracedb&first_page_size=100)
- [x] [`ligo-raven`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-raven&first_page_size=100)
- [x] [`ligo-segments`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo-segments&first_page_size=20)
- [x] [`ligo.em-bright`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo.em-bright&first_page_size=20)
- [x] [`ligo.skymap`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=ligo.skymap&first_page_size=100)
- [x] [`lscsoft-glue`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=lscsoft-glue&first_page_size=100)
- [x] [`pesummary`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=pesummary&first_page_size=100)
- [x] [`python-ligo-lw`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=python-ligo-lw&first_page_size=100)
- [x] [`rapidpe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=Rapidpe&first_page_size=20)
- [ ] [`rapidpe-rift-pipe`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=RapidPE%20pipeline&first_page_size=20)
- [x] [`RIFT`](https://git.ligo.org/computing/sccb/-/issues/?sort=updated_desc&state=all&search=rift&first_page_size=100)
## Test deployment
4. [x] Sentry does not show any new [unresolved issues on ~~test~~playground](https://sentry.io/organizations/ligo-caltech/issues/?environment=playground&groupStatsPeriod=14d&project=1425216&query=is%3Aunresolved&statsPeriod=14d) that indicate new bugs or regressions.
5. [x] The ~~test~~playground deployment has run for at least 10 minutes.
6. [x] The [Flower monitor](https://emfollow-playground.ligo.caltech.edu/flower) is reachable and shows no unexpected task failures.
7. [x] The [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) is reachable.
8. [x] The ~~test~~playground deployment is [connected to IGWN Alert](https://emfollow-playground.ligo.caltech.edu/flower/worker/gwcelery-worker%40emfollow-playground.ligo.caltech.edu#tab-other) (in Flower, find the main gwcelery-worker, click Other, and look at the list of subscribed IGWN Alert topics).
9. [x] The ~~test~~playground deployment is [connected to GCN](https://emfollow-playground.ligo.caltech.edu/flower/worker/gwcelery-voevent-worker%40emfollow-playground.ligo.caltech.edu#tab-other) (in Flower, find the voevent gwcelery-worker, click Other, and look at the list of receiver peers).
## Mock events
10. [x] The ~~test~~playground deployment has [produced an MDC superevent](https://gracedb-playground.ligo.org/latest/?query=MDC&query_type=S).
11. [x] The MDC superevent has the following annotations.
- [x] `bayestar.multiorder.fits`
- [x] `bayestar.fits.gz`
- [x] `bayestar.png`
- [x] `bayestar.volume.png`
- [x] `bayestar.html`
- [x] `p_astro.json`
- [x] `p_astro.png`
- [x] `em_bright.json`
- [x] `em_bright.png`
12. [x] The MDC superevent has the following labels.
- [x] `EMBRIGHT_READY`
- [x] `GCN_PRELIM_SENT`
- [x] `PASTRO_READY`
- [x] `SKYMAP_READY`
13. [x] The MDC superevent has two automatic preliminary VOEvents, JSON packets, and Avro packets if `GCN_PRELIM_SENT` is applied.
- [x] 2 preliminary VOEvents
- [x] 2 preliminary JSON packets
- [x] 2 preliminary Avro packets
14. [x] Issuing a manual preliminary alert from the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) sends another preliminary alert.
- [ ] The alert **is sent** successfully if `ADVOK` or an `ADVNO` label is **not applied** this time.
- [x] Alternatively, a preliminary alert is **blocked** due to presence of `ADVOK` or `ADVNO`.
15. [x] `DQR_REQUEST` label is applied to the superevent. The application happens at the time of launching the second preliminary alert.
16. [x] The MDC superevent has either an `ADVOK` or an `ADVNO` label.
17. [x] Issuing an `ADVOK` signoff through GraceDB results in an initial VOEvent.
18. [x] Issuing an `ADVNO` signoff through GraceDB results in a retraction VOEvent.
19. [x] Requesting an update alert through the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) results in an update VOEvent.
20. [x] ~~Test~~Playground has recently [produced an MDC superevent with an external coincidence](https://gracedb-playground.ligo.org/latest/?query=MDC+EM_COINC&query_type=S), i.e. with an `EM_COINC` label. Use the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) to do this manually (note that joint events with Swift may not pass publishing conditions and or have a combined sky map, indicated by the lack of `RAVEN_ALERT` and `COMBINEDSKYMAP_READY` label respectively).
21. [x] The joint MDC superevent has the following annotations.
- [x] `coincidence_far.json`
- [x] `combined-ext.multiorder.fits` or `combined-ext.fits.gz`
- [x] `combined-ext.png`
- [x] `overlap_integral.png`
22. [x] The joint MDC superevent has the following labels.
- [x] `EM_COINC`
- [x] `RAVEN_ALERT`
- [x] `COMBINEDSKYMAP_READY`
- [x] `GCN_PRELIM_SENT`
23. [x] The joint MDC superevent is sending alerts with coincidence information.
- [x] At least one VOEvent with `<Group name="External Coincidence">`.
- [x] At least one Kafka JSON packet with an `external_coinc` field.
- [x] At least one circular w/ `-emcoinc-` in filename.
24. [x] Issue a manual RAVEN alert using the [Flask dashboard](https://emfollow-playground.ligo.caltech.edu/gwcelery) for a coincidence (i.e. has `EM_COINC` label) that has does not have the `RAVEN_ALERT` label yet. Choose a [recent joint coincidence that meets this criteria](https://gracedb-playground.ligo.org/latest/?query=MDC+%7ERAVEN_ALERT+%26+EM_COINC&query_type=S&get_neighbors=&results_format=) and ensure that a `RAVEN_ALERT` label is applied to the associated superevent, external event, and preferred event.
## Replay events
24. [x] [A Production superevent labeled `GCN_PRELIM_SENT`](https://gracedb-playground.ligo.org/latest/?query=Production+GCN_PRELIM_SENT&query_type=S&get_neighbors=&results_format=) has the following parameter estimation annotations and the `PE_READY` label.
- [x] `bilby_config.ini`
- [x] `Bilby.posterior_samples.hdf5`
- [x] `Bilby.multiorder.fits`
- [x] `Bilby.html`
- [x] `Bilby.fits.gz`
- [x] `Bilby.png`
- [x] `Bilby.volume.png`
- [x] `PE_READY`
- [x] Link to PEsummary page (log message in parameter estimation section)GWCelery v2.2.1 Release