* [ ] Surabhi, Divya: Double check with Brockhill on how to go about just in time injections
* [ ] Surabhi, Divya: Double check with Brockhill on how to go about just in time injections
* [ ] Assigned to Cort/Leo : get the "file list too large" fixing commit on O4-offline-dev merged into master. Follow up with Kipp
*[ ] offline meeting with Chad, Anarya, Becca, Yun-Jing for snr maximization in composite event is the right thing to do. Anarya to schedule the meeting ([poll](https://www.when2meet.com/?18322371-Etkpw)). Chad needs to fill up poll
* [ ] Leo, Becca, Divya, Rachael: Look at dist_stats file size and make sure it is what is expected and whether it is contributing to high RAM usage
* [ ] Rachael: Ask Stuart about allocation for real data analysis
* [ ] Ron: Figure out configuration of ICDS for real data analysis
*[ ] offline meeting with Chad, Anarya, Becca, Yun-Jing for snr maximization in composite event is the right thing to do. Anarya to schedule the meeting ([poll](https://www.when2meet.com/?18322371-Etkpw))
*[ ] offline meeting with Chad, Anarya, Becca, Yun-Jing for snr maximization in composite event is the right thing to do. Anarya to schedule the meeting ([poll](https://www.when2meet.com/?18322371-Etkpw))
:arrow_forward: Might have meeting this week. Blocked by Chad, needs to fill the poll.
:arrow_forward: Might have meeting this week. Blocked by Chad, needs to fill the poll.
* [] Leo, Becca, Divya, Rachel: In the next couple weeks we should make a new template for the west dev call with updated projects
* [x] Leo, Becca, Divya, Rachel: In the next couple weeks we should make a new template for the west dev call with updated projects
:arrow_forward: Removed/Added
:arrow_forward: Removed/Added items. Looking for inputs.
* [ ] Cort: reach out to Shio for injection distribution plotting script
* [x] Cort: reach out to Shio for injection distribution plotting script
* [ ] Leo, Stefano: Work on installing latex dependencies for plotting job failures. Leo have an instruction note to follow.
:arrow_forward: Found it. Need to generate injections.
* [x] Leo, Stefano: Work on installing latex dependencies for plotting job failures. Leo have an instruction note to follow.
:arrow_forward: Same LaTeX packages are installed in Rocky container. Rebuild
## Agenda / Minutes
## Agenda / Minutes
* Announcements (5 minutes)
* Announcements (5 minutes)
- Please check the rota for next week's call
- Please check the rota for next week's call - Rachael
- Confirmation of next week's focus session
- Confirmation of next week's focus session - Victoria
- Leo: [Poll](https://docs.google.com/forms/d/e/1FAIpQLSfaDb2lgXGHrvlHnfF0nNTxr97-L362ApGr3y3M1wX4ZfW08Q/viewform) about data release in O4 and chunk splitting
* Last week's East call (https://wiki.ligo.org/CBC/Searches/GstLALEastAgenda20230126)
* Last week's East call (https://wiki.ligo.org/CBC/Searches/GstLALEastAgenda20230126)
* Quick updates (45 minutes)
* Quick updates (45 minutes)
- Operations (5 minutes)
- Operations (5 minutes)
- LL CBC operations
- LL CBC operations
- Divya: Jacob not running since analysis partition is full. Archiving O3 to get space. Edward and EW - Influx server full. Archived old EW stuff. Uploading to GarceDB. Everything other than monitoring not working. Edward has unexplainable increase in RAM.
- Surabhi: 2 EW analyses. Test analysis not getting data on dashboard. Can only see 2 topics from Edward on Kafka. All test suites had `send_inj_stream` fail with signal 9.
- Rachael: Look at size of `dist_stats` files to see whether they are affecting RAM. Launch analysis on actual L1 engineering data.
- Chad: Have more resources coming online. Should launch analysis.
- Ron: 50 nodes for full online analysis. 40 nodes for SSM. Can allocate less than 50 nodes. Will be using more than half of nodes.
- Ryan: Deploying Edward would be best. Cut bank towards BNS since it could be published.
- Ron: 24 hours for jobs on nodes to finish and become usable.
- Ryan: Plenty of signals expected in Engineering run.
- LL IDQ operations
- LL IDQ operations
- Rachael: Opened a paper repo. Offline iDQ stuff held up. Working on changing on all test scripts to match with master. Once offline is fixed, launch it for analysis and have it ready for review.
- GWSCI DOC: https://gwsci.org/ops/
- GWSCI DOC: https://gwsci.org/ops/
- Chad: Looking for feedback. Original overview slide probably not a good landing page, needs to be more nuts and bolts - what we're running, what the analyses are, etc. New overview page has 4 tabs. Documentation necessary - GitLab epics, GraceDB queries, dashboards, configs, containers, etc and brief descriptions of aim with relevant figures. Make sure config files up to date. 0th order thing - flesh out `.yml` file.
- Chad: Weekly Ops ROTA - reduce number of git issues and paperwork.
- Divya: Same members monitoring all analyses.
- Leo: Need to be mindful about people in other institutes.
- Chad: Online analysis should be priority. Big change, hard to task switch, need to take into account a lot of factors.
- Divya: Start this system with next MDC
- O4 Dev (30 minutes)
- O4 Dev (30 minutes)
- Low latency integrated testing and Monitoring
- Low latency integrated testing and Monitoring
- Leo: Using test suite, we monitor p-astro performance across pipelines.
- Template bank
- Template bank
- Shio: Updated the O4 temp bank paper on arxiv with completed bank sim results (on Jan 19). The SVD configuration detailes etc. Should go into the paper on top of what is currently in the paper.
- Likelihood ratio, background and foreground sampling
- Likelihood ratio, background and foreground sampling
- LIGOLW Injection Table (possible ideas)
- LIGOLW Injection Table (possible ideas)
- Victoria: Made Git issue and proposal. Looking for feedback.
- offline DAG
- offline DAG
- Cort: Tracking some log file to prevent a matplotlib error. Configuration for injection generation.
