Handle interruptions during parameter reconstruction
It would be good if we had some way of handling interrupts during the marginalised parameter reconstruction.
My first thought is to remove the parameter conversion from the call to run sampler and do the conversion after in the analysis script. This way we can add a flag that the sampling has finished and the result should just be directly read in. We would then need to set it up to catch any kill signals and ideally dump the current set of reconstructed samples and then exit and pick back up where it left off.
Another option would be to evict the job after the sampling finishes so the timer gets reset and then hope the reconstruction takes less than the eviction period.
The current issue is that the code is exiting with the wrong code when being interrupted and then being help.
Any thought @gregory.ashton?