passing injection frames manually
I am using pbilby 0.1.1 . I am trying to manually pass some injection frames I have been creating to test injections with pbilby.
I am encountering this problem running a test job at
HAWK:/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe
In my config file that you can inspect here:
config.ini
#[Job variables]
label = pbilby_injection_test
outdir = /home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe/outdir
#[Data grab]
#trigger_time = /home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/frames_0noise/trigger-time.txt
trigger_time= 1242442967.43164062
#[Detector]
detectors = [L1]
psd_dict = {L1:/home/nicola.delillo/design_sensitivity/PSD-aLIGO_design_LIGO-T1800044.txt}
channel_dict = {L1:HWINJ_INJECTED}
data_dict = {L1=/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/frames_0noise/L1-HWINJIMRPhenomD_1242442960_L1.gwf}
minimum-frequency=40
sampling-frequency=4096.
maximum-frequency=2048.
duration = 13
reference-frequency=20.
#[Calibration]
#[Waveform Approximant]
waveform_approximant = IMRPhenomD
#[Prior]
prior-file = /home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe/priorfile.prior
#[Likelihood]
time-marginalization=False
phase-marginalization=False
distance-marginalization=False
#[bilby pipe test]
time = 24:00:00
nodes = 1
ntasks-per-node =20
When I run the pbilby pipe parallel_bilby_generation config.ini
, pbilby is trying to access via Kerberos to download the GW data (also failing to reckognise my credentials).
I copy here the log I get after running the command:
generation pipe log message
00:01 bilby_pipe INFO : Command line arguments: Namespace(accounting=None, bilby_zero_likelihood_mode=False, calibration_model=None, channel_dict='{L1:HWINJ_INJECTED}', clean=False, cluster=None, coherence_test=False, create_plots=False, create_summary=False, data_dict='{L1=/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/frames_0noise/L1-HWINJIMRPhenomD_1242442960_L1.gwf}', data_dump_file=None, data_format=None, default_prior='BBHPriorDict', deltaT=0.2, detectors=['L1'], distance_marginalization=False, distance_marginalization_lookup_table=None, dlogz=0.1, duration=13.0, dynesty_bound='multi', dynesty_sample='rwalk', email=None, enlarge=1.5, existing_dir=None, extra_lines=None, facc=0.5, frequency_domain_source_model='lal_binary_black_hole', gaussian_noise=False, generation_seed=None, gps_file=None, idx=0, ini='config.ini', injection=False, injection_file=None, jitter_time=True, label='pbilby_injection_test', likelihood_type='GravitationalWaveTransient', local=False, local_generation=False, local_plot=False, maximum_frequency='2048.', maxmcmc=5000, mem_per_cpu='4000', minimum_frequency='40', n_check_point=100000, n_effective=5000, n_parallel=1, n_simulation=0, nact=5, nlive=1000, no_plot=False, nodes=1, ntasks_per_node=20, online_pe=False, osg=False, outdir='/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe/outdir', periodic_restart_time=43200, phase_marginalization=False, post_trigger_duration=2.0, postprocessing_arguments=None, postprocessing_executable=None, prior_file='/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe/priorfile.prior', process=None, psd_dict='{L1:/home/nicola.delillo/design_sensitivity/PSD-aLIGO_design_LIGO-T1800044.txt}', psd_fractional_overlap=0.5, psd_length=32, psd_maximum_duration=1024, psd_method='median', psd_start_time=None, rand_seed=1234, reference_frequency=20.0, request_cpus=1, request_memory=4, request_memory_generation=None, roq_folder=None, roq_scale_factor=1, sampler='dynesty', sampler_kwargs='Default', sampling_frequency=4096.0, sampling_seed=None, scheduler='condor', scheduler_args=None, scheduler_env=None, scheduler_module=None, singularity_image=None, spline_calibration_amplitude_uncertainty_dict=None, spline_calibration_envelope_dict=None, spline_calibration_nodes=5, spline_calibration_phase_uncertainty_dict=None, submit=False, time='24:00:00', time_marginalization=False, transfer_files=True, trigger_time=1242442967.4316406, tukey_roll_off=0.4, verbose=False, vol_check=8, vol_dec=0.5, walks=100, waveform_approximant='IMRPhenomD', webdir=None, zero_noise=False)
00:01 bilby_pipe INFO : Unknown command line arguments: []
00:01 bilby_pipe INFO : Setting prior-file to /home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/pe/priorfile.prior
00:01 bilby_pipe INFO : Setting segment duration 13.0s
00:01 bilby_pipe INFO : PSD duration set to 416.0s, 32x the duration 13.0s
00:01 bilby_pipe INFO : No calibration_model model provided, calibration marginalization will not be used
00:01 bilby_pipe INFO : Getting analysis-segment data for L1
00:01 bilby_pipe INFO : Calling TimeSeries.read('/home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/frames_0noise/L1-HWINJIMRPhenomD_1242442960_L1.gwf', 'L1:HWINJ_INJECTED', start=1242442956.4316406, end=1242442969.4316406, dtype=float64)
00:01 bilby_pipe WARNING : Unable to read in requested 13.0s duration of data from /home/nicola.delillo/projects/pbilby_test/pbilby_test_injection/frames_0noise/L1-HWINJIMRPhenomD_1242442960_L1.gwf only 13.000244140625s available
00:01 bilby_pipe INFO : Calling TimeSeries.get('L1:HWINJ_INJECTED', start=1242442956.4316406, end=1242442969.4316406, dtype='float64')
error detail: SASL(-1): generic failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (No Kerberos credentials available (default cache: KEYRING:persistent:100004172))
/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/io/nds2.py:298: NDSWarning: Error authenticating against nds.ligo.caltech.edu:31200
NDSWarning)
Please provide username for the LIGO.ORG kerberos realm: nicola.delillo
Password for nicola.delillo@LIGO.ORG:
kinit: Unknown credential cache type while getting default ccache
Traceback (most recent call last):
File "/home/nicola.delillo/.conda/envs/pbilby_testing/bin/parallel_bilby_generation", line 11, in
load_entry_point('parallel-bilby==0.1.1', 'console_scripts', 'parallel_bilby_generation')()
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/parallel_bilby-0.1.1-py3.7.egg/parallel_bilby/generation.py", line 34, in main
inputs = DataGenerationInput(args, [])
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/bilby_pipe/data_generation.py", line 156, in __init__
self.create_data(args)
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/bilby_pipe/data_generation.py", line 190, in create_data
self._set_interferometers_from_data()
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/bilby_pipe/data_generation.py", line 502, in _set_interferometers_from_data
det, self.get_channel_type(det), self.start_time, end_time
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/bilby_pipe/data_generation.py", line 569, in _get_data
data = self._gwpy_get(channel, start_time, end_time)
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/bilby_pipe/data_generation.py", line 686, in _gwpy_get
channel, start_time, end_time, verbose=False, dtype=dtype, **kwargs
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/timeseries/core.py", line 623, in get
verbose=verbose, allow_tape=allow_tape, **kwargs)[str(channel)]
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/timeseries/core.py", line 1397, in get
verbose=verbose, **kwargs)
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/timeseries/core.py", line 1149, in fetch
scaled=scaled, allow_tape=allow_tape_)
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/timeseries/core.py", line 1128, in fetch
connection = io_nds2.auth_connect(host, port)
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/io/nds2.py", line 299, in auth_connect
kinit()
File "/nfshome/store02/users/nicola.delillo/.conda/envs/pbilby_testing/lib/python3.7/site-packages/gwpy/io/kerberos.py", line 175, in kinit
raise subprocess.CalledProcessError(kget.returncode, ' '.join(cmd))
subprocess.CalledProcessError: Command '/home/nicola.delillo/.conda/envs/pbilby_testing/bin/kinit nicola.delillo@LIGO.ORG' returned non-zero exit status 1.
Proposed solution
Add a --path-to-frames
, --fake-frames
or --no-frames-download
, --no-download
or similar, that will skip Kerberos login. If you point me to the pipe script that reads the config and logs into with Kerberos, I am happy to hack, test and submit a merge request.
I think a simple if
on checking the --path-to-frames = True
would be enough.