Investigate condor periodic release for PE jobs
HTCondor has some machinery to periodically release held jobs. We should investigate using this as a workaround for manual intervention when problems like computing/helpdesk#4861 (this comment in particular) come up.
Some documentation can be found here. I know gstlal happens to use this feature, so I grabbed a couple of examples from there.
periodic_release = (HoldReasonCode == 5)
periodic_release = (HoldReasonCode == 5) || ((CurrentTime - EnteredCurrentStatus > 180) && (HoldReasonCode != 34))
This setting would go in the PE sub files
Edited by Cody Messick