Skip to content
Snippets Groups Projects

workflow change to refilter dropped data

Merged Leo Tsukada requested to merge refilter-dropped-data into offline_new-workflow
1 unresolved thread

Merge request reports

Pipeline #637930 passed

Pipeline passed for 75c73f48 on refilter-dropped-data

Approved by

Merged by Leo TsukadaLeo Tsukada 8 months ago (Jun 24, 2024 3:24pm UTC)

Merge details

  • Changes merged into offline_new-workflow with 75c73f48.
  • Deleted the source branch.
  • Auto-merge enabled

Pipeline #637941 passed

Pipeline passed for 75c73f48 on offline_new-workflow

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
258
259 trigger_cache += DataCache.generate(
260 DataType.TRIGGERS,
261 config.ifo_combos,
262 time_bins,
263 svd_bins=svd_bin,
264 root=config.data.filter_dir,
265 )
266
267 dist_stats = dist_stat_cache.groupby("ifo", "time", "bin")
268 for (ifo_combo, span), triggers in trigger_cache.groupby("ifo", "time").items():
269 ifos = config.to_ifo_list(ifo_combo)
270 ref_psds_time = ref_psds_ifo[ifo_combo].groupby("time")
271 # find corresponding psd segments inclusing corner cases where psd job
272 # boundaries fall in between the inspiral job boundaries.
273 span_tmp = [span_psd_tmp for span_psd_tmp in ref_psds_time if span in span_psd_tmp or (span[0] < span_psd_tmp[0] and span_psd_tmp[0] < span[1]) or (span[0] < span_psd_tmp[1] and span_psd_tmp[1] < span[1])]
  • Leo Tsukada added 81 commits

    added 81 commits

    • af55b8de...9633c478 - 71 earlier commits
    • efdf9092 - Give 2 seconds of padding instead of 1 around injection times to the segments...
    • d7bf989c - Update Disk and Memory requests to the values required by a chunk-long offline inj+noninj analysis
    • a432b969 - add noiseless injection and shift-time workflow to fake_frames_workflow
    • 0f5c19c0 - __isub__ method minor bug fix: changing all() to ().all()
    • cdfee40f - Updated svd bank jobs' memory request to 7GB (This is required for EW jobs)
    • 6687aa07 - plot_sensitivity: fix the output dir for xml files so that it can be transfered back in the dag
    • 9f36f8fa - implement LR-based masked sampling
    • 1dbf19ea - Changes to rank online & offline injections and
    • 50f6c074 - Changes needed for offline injection frame filtering.
    • 580d1cf3 - implement a dag to refilter dropped data in online analysis (conflict

    Compare with previous version

  • Leo Tsukada changed target branch from offline_new-workflow_injection-frame-cache to offline_new-workflow

    changed target branch from offline_new-workflow_injection-frame-cache to offline_new-workflow

  • Leo Tsukada added 1 commit

    added 1 commit

    Compare with previous version

  • Leo Tsukada added 4 commits

    added 4 commits

    • 189cfe9e - 1 commit from branch offline_new-workflow
    • 70f3a5c6 - Changes needed for offline injection frame filtering.
    • e567cd06 - implement a dag to refilter dropped data in online analysis (conflict
    • 5ed18f5f - debug some corner cases

    Compare with previous version

  • Leo Tsukada added 3 commits

    added 3 commits

    • 651840d3 - 1 commit from branch offline_new-workflow
    • ceac3c0c - implement a dag to refilter dropped data in online analysis (conflict
    • a2a17aea - debug some corner cases

    Compare with previous version

  • Leo Tsukada added 3 commits

    added 3 commits

    • 45a2a263 - 1 commit from branch offline_new-workflow
    • 51eeeb5d - implement a dag to refilter dropped data in online analysis (conflict
    • 39122ff8 - debug some corner cases

    Compare with previous version

  • Leo Tsukada added 1 commit

    added 1 commit

    • 75c73f48 - implement a dag to refilter dropped data in online analysis

    Compare with previous version

  • Leo Tsukada approved this merge request

    approved this merge request

  • Leo Tsukada enabled an automatic merge when the pipeline for 75c73f48 succeeds

    enabled an automatic merge when the pipeline for 75c73f48 succeeds

  • merged

  • Please register or sign in to reply
    Loading