Logging Patch + Extension of Queues in Injection Streamer

This patch has two goals:

1. improvement of logging.
   • move print statements to logging
   • move non-production info logging to debug
   • move progress reports under verbose flags
2. Extension of queues
   • extend queues just after sources to protect against variation in reading from disk

requested review from @chad-hanna and @patrick.godwin

assigned to @rachael.huxford

added 1 commit

• cae843f7 - Extension of queues for more stable long-term running.

Compare with previous version

Looks good, just one minor set of suggestions for logging.

added 1 commit

• b2934c9a - Extension of queues for more stable long-term running.

Compare with previous version

added 1 commit

• 193de347 - Extension of queues for more stable long-term running.

Compare with previous version

resolved all threads

Apologize for the late-ness of this comment. But Kipp approved on an East call with the note to change the verbose variable everywhere to options.verbose else it is easy to overwrite that variable by accident without realizing the repercussions.

added 1 commit

• eb95a069 - Move verbose calls -> options.verbose

Compare with previous version

added 4 commits

• 6c8f0514 - 1 commit from branch master
• 96dfc3d5 - Clean up of logging. Addition of verbose protection against excessive progress reports.
• c46f0873 - Extension of queues for more stable long-term running.
• 46af0486 - Move verbose calls -> options.verbose

Compare with previous version

merged