Commits on Source (20)
-
Deep Chatterjee authored
-
-
Leo P. Singer authored
Fixes #876.
-
-
-
-
Leo P. Singer authored
Fixes #880.
-
Leo P. Singer authored
The kafka-consumer queue did not execute any tasks; it existed only as a convenient way to mark which process should launch the Kafka consumer bootstep.
-
Leo P. Singer authored
Originally, we allocated a dedicated queue for GWSkyNet tasks because they needed a lot of memory and because they used many CPUs and the flavor of parallelism was poorly understood (#514). Their memory usage is now greatly reduced by using multi-resolution sky maps and the flavor of parallelism is now well understood as resulting from OpenMP usage in ligo.skymap volume rendering (manleong.chan/gwskynet#5). It is now safe to reallocate GWSkyNet tasks to the workers that we have dedicated for OpenMP parallel workflows. This patch directs GWSkyNet tasks to the `openmp` queue and retires the now unnecssary `skynet` queue. This simplifies deployment while also reducing resource requirements, both on the cluster and in Kubernetes development setups. There is a FIXME comment noting that even the high CPU usage stemming from the OpenMP-parallel volume rendering may eventually be unnecessary (see manleong.chan/gwskynet#6).
-
Leo P. Singer authored
Fixes #881.
-
-
-
Leo P. Singer authored
- Remove verbose (`-v`) flag - Print output only if it fails - Don't log to a file; we already get an email if there is any output
-
Brandon Piotrzkowski authored
-
Sushant Sharma-Chaudhary authored
-
Sushant Sharma-Chaudhary authored
-
Sushant Sharma-Chaudhary authored
-
Sushant Sharma-Chaudhary authored
-
Sushant Sharma-Chaudhary authored
-
Sushant Sharma-Chaudhary authored
Showing
- .gitlab-ci.yml 6 additions, 0 deletions.gitlab-ci.yml
- CHANGES.rst 13 additions, 0 deletionsCHANGES.rst
- doc/design.rst 7 additions, 2 deletionsdoc/design.rst
- doc/quickstart.rst 1 addition, 0 deletionsdoc/quickstart.rst
- gwcelery/conf/minikube.py 12 additions, 5 deletionsgwcelery/conf/minikube.py
- gwcelery/data/gwcelery.sub 6 additions, 13 deletionsgwcelery/data/gwcelery.sub
- gwcelery/igwn_alert/bootsteps.py 3 additions, 3 deletionsgwcelery/igwn_alert/bootsteps.py
- gwcelery/kafka/bootsteps.py 2 additions, 2 deletionsgwcelery/kafka/bootsteps.py
- gwcelery/tasks/alerts.py 4 additions, 4 deletionsgwcelery/tasks/alerts.py
- gwcelery/tasks/external_triggers.py 17 additions, 3 deletionsgwcelery/tasks/external_triggers.py
- gwcelery/tasks/gwskynet.py 3 additions, 1 deletiongwcelery/tasks/gwskynet.py
- gwcelery/tasks/raven.py 4 additions, 4 deletionsgwcelery/tasks/raven.py
- gwcelery/tasks/rrt_utils.py 47 additions, 3 deletionsgwcelery/tasks/rrt_utils.py
- gwcelery/tasks/skymaps.py 2 additions, 2 deletionsgwcelery/tasks/skymaps.py
- gwcelery/tests/data/fermi_final_gcn.xml 108 additions, 0 deletionsgwcelery/tests/data/fermi_final_gcn.xml
- gwcelery/tests/data/fermi_grb_gcn.xml 2 additions, 2 deletionsgwcelery/tests/data/fermi_grb_gcn.xml
- gwcelery/tests/data/rrt_small_area.fits 0 additions, 0 deletionsgwcelery/tests/data/rrt_small_area.fits
- gwcelery/tests/test_tasks_external_triggers.py 11 additions, 6 deletionsgwcelery/tests/test_tasks_external_triggers.py
- gwcelery/tests/test_tasks_first2years.py 1 addition, 3 deletionsgwcelery/tests/test_tasks_first2years.py
- gwcelery/tests/test_tasks_first2years_external.py 2 additions, 2 deletionsgwcelery/tests/test_tasks_first2years_external.py
gwcelery/tests/data/fermi_final_gcn.xml
0 → 100644
No preview for this file type