Ultranest breaking scheduled tests

See https://git.ligo.org/lscsoft/bilby/-/jobs/848868#L137 for details

@matthew-pitkin do you have any idea what is happening here?