Upload kafka alert notice after sending
This MR will upload the alert dictionary as a json file to the superevent after kafka alerts have been sent. It's uploaded after because the kafka alert worker currently uses a solo pool, so adding this upload task to the kafka alert send group before the send tasks would delay the alerts (see #450).
Oct 6 edit: The task that uploads the notice json to gracedb now is next in the chain after the tasks that send the kafka notices, instead of being in the same group.
Oct 11 edit: The task now adds an upload task to the queue instead of performing the upload itself, and uploads the serialized messages (i.e. a .avro file for the scimma notice and a .json file for the gcn notice).
This MR depends on !944 (merged) because the unit tests fail due to the skymap being included in the alert dictionary when uploading after sending the alerts. !944 (merged) makes it so the skymap is never added to the alert_dict variable that is shared between tasks.
Merge request reports
Activity
mentioned in merge request !944 (merged)
Resolved by Leo Pound SingerCould we please upload the alert payload with the sky map?
- Last reply by Cody Messick
added 1 commit
- 67d7e41c - Upload alert dictionary used to generate Kafka alert notices to gracedb
mentioned in issue #453 (closed)
mentioned in issue #457 (closed)
added 8 commits
-
67d7e41c...732772c1 - 7 commits from branch
emfollow:main - ab2186bf - Upload alert dictionary used to generate Kafka alert notices to gracedb
-
67d7e41c...732772c1 - 7 commits from branch
added 1 commit
- a4b21f0e - Upload alert dictionary used to generate Kafka alert notices to gracedb
added 1 commit
- 0fa0b901 - Upload alert dictionary used to generate Kafka alert notices to gracedb
- Resolved by Leo Pound Singer
Marked this as a draft because I saw a new error pop up on test. I'll remove the draft designation when I fix the bug.
- Last reply by Cody Messick