* [ ] Assigned to Cort/Leo : get the "file list too large" fixing commit on O4-offline-dev merged into master
:arrow_forward: Leo brought this up to Kipp in East Call 2 weeks ago. Kipp was ok with fixing the bug, but wants to rethink current option to disable VT jobs. Blocked by Kipp. Might be done in 2 weeks. :arrow_right: Leo will bring up in east call this week to get it under Kipp’s radar
* [ ] Surabhi, Divya: Double check with Brockhill on how to go about just in time injections :arrow_right: Divya will contact Brockhill
* [ ] Leo, Becca, Divya, Rachael: Look at dist_stats file size and make sure it is what is expected and whether it is contributing to high RAM usage :arrow_right: follow up needed. More in minutes
- Divya contacted him yesterday, asking for his insight.
* [ ] Leo, Becca, Divya, Rachael: Look at dist_stats file size and make sure it is what is expected and whether it is contributing to high RAM usage
- found that some corner case in idq setting was the cause
* [ ] Chad: catch up with Ron about figuring out configuration of ICDS for real data analysis
- Ron: we didn’t speak. Some testing is in progress, but needs some confirmation of what the final directory structure will look like.
* [ ] Becca: go to East call and get the open MR merged before MDC 11.
* [ ] Rachel: MDC documentation needs to be updated since a lot of documentation is missing/wrong. We want to do this before tmr’s sprint
*[ ] Rachel: add task to this week's MDC rota to look into [this issue](https://gstlal.ligo.caltech.edu/grafana/d/h7V_Xxn4k/early-warning-dashboard?orgId=1&var-ginterval=100s&var-DashDatasource=ew_replay_MDC10&var-fmax=All&from=1675555200000&to=1675688399000)
- Becca: new dashboard, variable threshold instead of hardcoded one. You can pick from a bunch of different FAR thresholds, and the whole dashboard will refresh based on that. Looking for feedback. Link to the dashboard is [here](https://gstlal.ligo.caltech.edu/grafana/d/vlTWYqAVz/new-and-improved-test-suite?orgId=1&var-DashDatasource=toggle_far_test&var-far=oneperhour&from=now-24h&to=now&var-pastro_name=gstlal&refresh=10s)
- Template bank
- Shio: No updates
- Likelihood ratio, background and foreground sampling
- Leo: Shomik and I discovered problem with dtdpthi term, by looking at MDC09 retractions. THere was an inconsistency in the dt dphi parameters. MR is [here](https://git.ligo.org/lscsoft/gstlal/-/merge_requests/395). Has been happening for the last few years, is pretty serious, heppened when Kagra was added, so it's post O3.
- Jolien: Is EW just HL or is it HLV?
- Shio: working on printing out the individual LR components when one gives "--verbose" when running commands for the gstlal_inspiral_calc_likelihood code. Not quite in shape yet. Planning to make an MR so that it's part of the code, and usable.
- Injection file format
- No updates
- offline DAG
- Shio: was looking at the LVC rates injections code (as a replacement for lalapps_inspinj), found some issues with it. Sent an email to Sarah about it.
- Cort: Have an MR for the matplotlib issue. It will create a local cache dir
- DQ dev
- HM search
- Stefano: Been running a test dag for precession. [This](https://ldas-jobs.ligo.caltech.edu/~stefano.schmidt/gstlal/testrun_20230119_precession/money_plots.html) money plot looks bad. Is this expected for precession?
- Ryan: Looking at the kink in the LR curve, maybe it's just undersampled.
- Jolien and Ryan: Increasing the time of the run will also probably help a lot, becuase it's not enough time for the number of templates
- Exploratory development (5 minutes)
- Rachael: Time slide files have HLV hardcoded, so when running a HL analysis, the dist_stats files don't work
- Becca: Maybe misremembering, but this was solved by providing HLV in the config, but channels for only HL
- Rachael: Also saw Virgo frames, maybe we should run a HLV search for Renee instead of HL?
- Ryan: Virgo's sensitivity is very low, so probably not a good idea.
- Misc projects
- Paper Updates
- Becca: Planning to use MDC11 data for the paper
- Shio: planning to do a poster on the O4 temp bank stuff in the LVK march mtg
* Focus session
-**ADDME**
* AOB
- Divya: R&P's plan is to do injections with a hopeless cut of SNR = 5, generated monthly with the previous month's PSD. First set generated usign representative PSD from Eng runs. They need people to help. Me and Victoria are the choices. Inj spacing 7sec, they want to know if it's too small
- Jolien: many inj are going to be very weak, so maybe it's not a reason to worry.
- Divya: question for Cody. Could we use gstlal group injections on them?
- Cody: 7sec sounds fine
- Jolien: Is it possible to do something like low Mc inj only get processed by low Mc bins?
- Cody: that would need seperate channels for different jobs
- Jolien: Poisson rates mean there will be many weak inj between loud ones
- Jolien: Why 7 sec? How many injections do they want?
- Divya: A million, over O4 (18 months)
- Divya: Will run a test analysis, and will check if 7 sec is a good spacing
## Chat log
<13:39:36> "Divya Singh": we didn't get a chance to look into this
<14:04:46> "Rachael Huxford": I think instead of devshm you need to provide like white or something?
<14:04:52> "ryan.magee": Yeah I think so, i've never tried running that offline though. It might be online mode only
<14:05:09> "Divya Singh": https://git.ligo.org/lscsoft/gstlal/-/blob/master/gstlal/python/datasource.py#L731 give white here?
<14:05:23> "jolien.creighton": presumably you need to tell it what psd to use
<14:05:29> "jolien.creighton": (since it can't be measured)
<14:05:31> "stefano.schmidt": right!
<14:06:04> "Shio.Sakon": I forgot one thing about the LR. I'm working on printing out the individual LR components when one gives "--verbose" when running commands for the gstlal_inspiral_calc_likelihood code. Not quite in shape yet. Planning to make an MR so that it's part of the code, and usable.
<14:07:01> "Leo Tsukada": hand up
<14:07:06> "Rachael Huxford": can you not put it once in the numerator and once in the denominator code maybe?
<14:14:41> "ryan.magee": I thought at like O(10 Mpc) but that might be old info.
<14:16:19> "Leo Tsukada": no updates for LR paper
<14:16:26> "Rachael Huxford": none for iDQ
<14:16:53> "Shio.Sakon": planning to do a poster on the O4 temp bank stuff in the LVK march mtg
<14:16:58> "Divya Singh": hand up
<14:17:10> "Becca Ewing": i was
<14:17:16> "Becca Ewing": yes
<14:19:39> "jolien.creighton": hand up
<14:22:12> "ryan.magee": well also, this is online inj right?
<14:22:22> "Leo Tsukada": does anyone remember the clustering window?
<14:22:43> "ryan.magee": LR is 4 s? We keep switching it
<14:22:50> "Cody Messick": it was +- 4 seconds unless it got changed
<14:23:24> "Leo Tsukada": thanks
<14:23:26> "ryan.magee": Still 4 s https://git.ligo.org/lscsoft/gstlal/-/blob/master/gstlal-inspiral/share/simplify_and_cluster.sql#L206
<14:24:20> "ryan.magee": hopefully
<14:25:31> "Cody Messick": I feel like...yeah it's gotta be fine
<14:25:43> "Cody Messick": the correlation between templates goes down really quickly right
<14:26:02> "Cody Messick": like i bet the biggest risk would be having two waveforms with very similar parameters, but a wide distribution makes that way less likely
