The until_eos option is causing autocommit to fail in the consumer.
until_eos
[2022-08-25 14:07:50,672: WARNING/MainProcess/IGWNReceiverThread] File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/threading.py", line 973, in _bootstrap_inner [2022-08-25 14:07:50,673: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,674: WARNING/MainProcess/IGWNReceiverThread] self.run() [2022-08-25 14:07:50,675: WARNING/MainProcess/IGWNReceiverThread] File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/integrations/threading.py", line 69, in run [2022-08-25 14:07:50,675: INFO/MainProcess/MainThread] Task gwcelery.tasks.gracedb.create_label[5affd21d-d50a-4a21-adac-e08335f3bf45] received [2022-08-25 14:07:50,676: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,678: WARNING/MainProcess/IGWNReceiverThread] reraise(*_capture_exception()) [2022-08-25 14:07:50,679: WARNING/MainProcess/IGWNReceiverThread] File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 54, in reraise [2022-08-25 14:07:50,685: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,686: WARNING/MainProcess/IGWNReceiverThread] raise value [2022-08-25 14:07:50,686: WARNING/MainProcess/IGWNReceiverThread] File "/home/emfollow-playground/.local/lib/python3.9/site-packages/sentry_sdk/integrations/threading.py", line 67, in run [2022-08-25 14:07:50,687: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,687: WARNING/MainProcess/IGWNReceiverThread] return old_run_func(self, *a, **kw) [2022-08-25 14:07:50,688: WARNING/MainProcess/IGWNReceiverThread] File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/threading.py", line 910, in run [2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread] self._target(*self._args, **self._kwargs) [2022-08-25 14:07:50,689: WARNING/MainProcess/IGWNReceiverThread] File "/home/emfollow-playground/.local/lib/python3.9/site-packages/gwcelery/igwn_alert/bootsteps.py", line 55, in listen [2022-08-25 14:07:50,690: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,691: WARNING/MainProcess/IGWNReceiverThread] for payload, metadata in s.read( [2022-08-25 14:07:50,691: WARNING/MainProcess/IGWNReceiverThread] File "/home/emfollow-playground/.local/lib/python3.9/site-packages/hop/io.py", line 340, in read [2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread] for message in self._consumer.stream(autocommit=autocommit, **kwargs): [2022-08-25 14:07:50,692: WARNING/MainProcess/IGWNReceiverThread] File "/cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/envs/igwn-py39-20220317/lib/python3.9/site-packages/adc/consumer.py", line 167, in _stream_until_eof [2022-08-25 14:07:50,693: WARNING/MainProcess/IGWNReceiverThread] [2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] partition_set.remove(m.partition()) [2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] KeyError [2022-08-25 14:07:50,694: WARNING/MainProcess/IGWNReceiverThread] : [2022-08-25 14:07:50,695: WARNING/MainProcess/IGWNReceiverThread] 0
