Skip to content

Until eos false

Deep Chatterjee requested to merge deep.chatterjee/gwcelery:until-eos-false into main

The until_eos option is causing autocommit to fail in the consumer.

[2022-08-25 14:07:50,672: WARNING/MainProcess/IGWNReceiverThread]   File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/threading.py", line 973, in _bootstrap_inner
[2022-08-25 14:07:50,673: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,674: WARNING/MainProcess/IGWNReceiverThread] self.run()
[2022-08-25 14:07:50,675: WARNING/MainProcess/IGWNReceiverThread]   File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/integrations/threading.py", line 69, in run
[2022-08-25 14:07:50,675: INFO/MainProcess/MainThread] Task gwcelery.tasks.gracedb.create_label[5affd21d-d50a-4a21-adac-e08335f3bf45] received
[2022-08-25 14:07:50,676: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,678: WARNING/MainProcess/IGWNReceiverThread] reraise(*_capture_exception())
[2022-08-25 14:07:50,679: WARNING/MainProcess/IGWNReceiverThread]   File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 54, in reraise
[2022-08-25 14:07:50,685: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,686: WARNING/MainProcess/IGWNReceiverThread] raise value
[2022-08-25 14:07:50,686: WARNING/MainProcess/IGWNReceiverThread]   File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/integrations/threading.py", line 67, in run
[2022-08-25 14:07:50,687: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,687: WARNING/MainProcess/IGWNReceiverThread] return old_run_func(self, *a, **kw)
[2022-08-25 14:07:50,688: WARNING/MainProcess/IGWNReceiverThread]   File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/threading.py", line 910, in run
[2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread] self._target(*self._args, **self._kwargs)
[2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread]   File "/home/emfollow-playground/.local/lib/python3.9/site-packages/gwcelery/igwn_alert/bootsteps.py", line 55, in listen
[2022-08-25 14:07:50,690: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,691: WARNING/MainProcess/IGWNReceiverThread] for payload, metadata in s.read(
[2022-08-25 14:07:50,691: WARNING/MainProcess/IGWNReceiverThread]   File "/home/emfollow-playground/.local/lib/python3.9/site-packages/hop/io.py", line 340, in read
[2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread] for message in self._consumer.stream(autocommit=autocommit, **kwargs):
[2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread]   File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/site-packages/adc/consumer.py", line 167, in _stream_until_eof
[2022-08-25 14:07:50,693: WARNING/MainProcess/IGWNReceiverThread]
[2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] partition_set.remove(m.partition())
[2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] KeyError
[2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] :
[2022-08-25 14:07:50,695: WARNING/MainProcess/IGWNReceiverThread] 0
Edited by Deep Chatterjee

Merge request reports