Skip to content

idq-batch bins split by livetime

Patrick Godwin requested to merge batch_bins into master

This allows idq-batch to split up bins equally based on the livetime rather than wall-time. The segdb logic was reused from batch.train and uses utils.segments_kfold to do the splitting, which has some unit tests to show its correctness.

Here is an example of running idq-batch with 2 bins:

2019-04-23 16:32:00,876 | mla_comparison-batch : INFO : retained 82109.000 sec of livetime
2019-04-23 16:32:00,876 | mla_comparison-batch : INFO : dividing bins equally based on livetime
2019-04-23 16:32:00,877 | mla_comparison-batch : INFO :     bin 1 -- span: [1238696294.000, 1238741432.500), livetime: 41054.500 sec
2019-04-23 16:32:00,877 | mla_comparison-batch : INFO :     bin 2 -- span: [1238741432.500, 1238782702.000), livetime: 41054.500 sec

Update: Also adding in causal batch and checkerboarding schemes as well.

Closes reed.essick/iDQ#24.

Edited by Patrick Godwin

Merge request reports