Hard Time limit of 600s killing for gwcelery.tasks.superevents.process of playground G-event G1493376
Sentry error:
- Process "ForkPoolWorker-4" pid:1681044 exited with "signal 9 (SIGKILL)"
- Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[96757e7f-fcaa-44d6-ac57-a3e221b955f7]
[emfollow-playground@emfollow-playground ~]$ grep 96757e7f-fcaa-44d6-ac57-a3e221b955f7 gwcelery-superevent-worker.log
[2024-01-24 14:59:27,665: INFO/MainProcess/MainThread] Task gwcelery.tasks.superevents.process[96757e7f-fcaa-44d6-ac57-a3e221b955f7] received
[2024-01-24 15:01:30,551: INFO/ForkPoolWorker-4] gwcelery.tasks.superevents.process[96757e7f-fcaa-44d6-ac57-a3e221b955f7]: Event G1493376 does not yet belong to a superevent
[2024-01-24 15:11:30,559: ERROR/MainProcess/MainThread] Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[96757e7f-fcaa-44d6-ac57-a3e221b955f7]
The G-event G1493376 belong to S-event: https://gracedb-playground.ligo.org/superevents/S240124en/view/ It was uploaded: 2024-01-24 22:26:54.93 and added to S-event on 2024-01-24 23:12:24.56 The error was matched four times:
[emfollow-playground@emfollow-playground ~]$ grep "Hard time limit" gwcelery-superevent-worker.log
[2024-01-24 14:31:00,624: ERROR/MainProcess/MainThread] Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[8216696b-66c7-4307-90be-a347aff242d8]
[2024-01-24 14:41:05,684: ERROR/MainProcess/MainThread] Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[15335f44-abfe-4407-8a0a-c2b98933ddfc]
[2024-01-24 14:55:19,795: ERROR/MainProcess/MainThread] Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[85513d52-c2d8-433c-ba2a-91e66e0a31fe]
[2024-01-24 15:11:30,559: ERROR/MainProcess/MainThread] Hard time limit (600s) exceeded for gwcelery.tasks.superevents.process[96757e7f-fcaa-44d6-ac57-a3e221b955f7]