WIP: Streaming workflow

implements a streaming workflow to asynchronously

low-latency

• for each IFO
  • discover data
  • estimate PSD
  • write PSD to disk
• for a network
  • discover PSDs
  • instantiate a network
  • instantiate a sampling distribution
  • generate samples
  • write samples to disk

high-latency (command-line tools)

• discover samples
• agglomerate/summarize samples
• write summary sample data products to disk
• discover PSDs
• agglomerate/summarize PSDs
• write summary PSD data products to disk

distributed workflows (condor)

• discover samples
• agglomerate/summarize samples
• write summary sample data products to disk
• discover PSDs
• agglomerate/summarize PSDs
• write summary PSD data products to disk

Much of this material is taken from: https://github.com/reedessick/exposure