Skip to content

Upload kafka alert notice after sending

Cody Messick requested to merge cody.messick/gwcelery:upload_alert_dict into main

This MR will upload the alert dictionary as a json file to the superevent after kafka alerts have been sent. It's uploaded after because the kafka alert worker currently uses a solo pool, so adding this upload task to the kafka alert send group before the send tasks would delay the alerts (see #450).

Oct 6 edit: The task that uploads the notice json to gracedb now is next in the chain after the tasks that send the kafka notices, instead of being in the same group.

Oct 11 edit: The task now adds an upload task to the queue instead of performing the upload itself, and uploads the serialized messages (i.e. a .avro file for the scimma notice and a .json file for the gcn notice).

This MR depends on !944 (merged) because the unit tests fail due to the skymap being included in the alert dictionary when uploading after sending the alerts. !944 (merged) makes it so the skymap is never added to the alert_dict variable that is shared between tasks.

Edited by Cody Messick

Merge request reports