Numpy error in dynesty plotting
Some of my runs are running into an issue in the middle of sampling, crashing the entire thing: ---
00:03 bilby INFO : Run interrupted by alarm signal 14: checkpoint and exit on 77
00:03 bilby INFO : Written checkpoint file working/GW200316_215756/Prod0/result/Prod0_data0_1268431094-157825_analysis_H1L1V1_par0_resume.pickle
00:03 bilby INFO : Starting to close worker pool.
00:03 bilby INFO : Finished closing worker pool.
00:04 bilby WARNING : Unexpected error <built-in method __deepcopy__ of numpy.ndarray object at 0x148521eb7a50> returned a result with an error set in dynesty plotting. Please report at git.ligo.org/lscsoft/bilby/-/issues
The full traceback is below:
Traceback (most recent call last):
File "/home/ubuntu/Software/bilby_pipe/install/bin/bilby_pipe_analysis", line 33, in <module>
sys.exit(load_entry_point('bilby-pipe==0.0.0', 'console_scripts', 'bilby_pipe_analysis')())
File "/home/ubuntu/Software/bilby_pipe/bilby_pipe/data_analysis.py", line 379, in main
analysis.run_sampler()
File "/home/ubuntu/Software/bilby_pipe/bilby_pipe/data_analysis.py", line 264, in run_sampler
self.result = bilby.run_sampler(
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/bilby/core/sampler/__init__.py", line 234, in run_sampler
result = sampler.run_sampler()
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/bilby/core/sampler/base_sampler.py", line 96, in wrapped
output = method(self, *args, **kwargs)
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/bilby/core/sampler/dynesty.py", line 517, in run_sampler
out = self._run_external_sampler_with_checkpointing()
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/bilby/core/sampler/dynesty.py", line 635, in _run_external_sampler_with_checkpointing
self.sampler.run_nested(**sampler_kwargs)
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/dynesty/sampler.py", line 941, in run_nested
for it, results in enumerate(
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/dynesty/sampler.py", line 774, in sample
u, v, logl, nc = self._new_point(loglstar_new)
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/dynesty/sampler.py", line 385, in _new_point
u, v, logl, nc, blob = self._get_point_value(loglstar)
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/dynesty/sampler.py", line 368, in _get_point_value
self._fill_queue(loglstar)
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/site-packages/dynesty/sampler.py", line 361, in _fill_queue
self.queue = list(mapper(evolve_point, args))
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/multiprocessing/pool.py", line 473, in _map_async
self._check_running()
File "/home/ubuntu/.conda/envs/local-pe/lib/python3.9/multiprocessing/pool.py", line 350, in _check_running
raise ValueError("Pool not running")
ValueError: Pool not running