Skip to content

Set pandas requirement to <2.0.0

Luke Davis requested to merge fix/pandas_pickle_compat into main

When loading the pastro model I was getting this error:

 2023-06-03 01:30:29 - spiir - DEBUG - Initialising file log output to ./logs/p-astro-consumer.log.                                                                                         
2 Traceback (most recent call last):                                                                                                                                                       
3   File "p-astro-consumer.py", line 132, in <module>                                                                                                                                      
4     main(**args.__dict__)                                                                                                                                                                
5   File "p-astro-consumer.py", line 114, in main                                                                                                                                          
6     model.load(signal_config, source_config)                                                                                                                                             
7   File "/home/spiir/.conda/envs/spiir-py38/lib/python3.8/site-packages/spiir/search/p_astro/models.py", line 193, in load                                                                
8     self.signal_model.load(signal_config)                                                                                                                                                
9   File "/home/spiir/.conda/envs/spiir-py38/lib/python3.8/site-packages/spiir/search/p_astro/models.py", line 161, in load                                                               
10     self.load_pkl(file_path)                                                                                                                                                            
11   File "/home/spiir/.conda/envs/spiir-py38/lib/python3.8/site-packages/spiir/search/p_astro/models.py", line 176, in load_pkl                                                           
12     self.__dict__ = pickle.load(f)                                                                                                                                                      
13 ModuleNotFoundError: No module named 'pandas.core.indexes.numeric'

which, according to https://stackoverflow.com/questions/75953279/modulenotfounderror-no-module-named-pandas-core-indexes-numeric-using-metaflo is due to breaking backwards compatability when loading a 1.x pickle with pandas 2.0.
At the moment our p-astro models were saved in pandas 1.x so we must use 1.x when loading them.

Edited by Luke Davis

Merge request reports