... | @@ -56,3 +56,48 @@ Chair / Minute Taker / Focus Session [Rota](https://git.ligo.org/groups/gstlal/- |
... | @@ -56,3 +56,48 @@ Chair / Minute Taker / Focus Session [Rota](https://git.ligo.org/groups/gstlal/- |
|
- planning for KAGRA data ([issue](https://git.ligo.org/cbc/action_items/-/issues/53))
|
|
- planning for KAGRA data ([issue](https://git.ligo.org/cbc/action_items/-/issues/53))
|
|
|
|
|
|
## Chat log
|
|
## Chat log
|
|
|
|
|
|
|
|
|
|
|
|
## Minutes
|
|
|
|
|
|
|
|
Minutes taken using Fathom AI, for full transcript and details see [Fathom](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff).
|
|
|
|
|
|
|
|
* Leo started the conversation and greeted everyone for Halloween. He mentioned that Scott's AI was taking a minute, so they decided to discuss the last action item from the previous week and Leo offered to share his screen. - [PLAY @5:00](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=300.0)
|
|
|
|
* Leo and Pratyusava discussed making changes to the data generation code to add environment scripts to the sub files. Pratyusava confirmed that the modifications have been made and the batches are ready for testing. - [PLAY @5:39](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=339.08)
|
|
|
|
* **Condor Upgrades at CIT** - Pratyusava modified the data generation code to add emberscripts, and Leo needs to test it. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=399.644445)
|
|
|
|
* Leo was discussing a problem with killing the dad or manually interrupting the job, which was also reproduced in his test. He was trying to identify the specific part of the code that was not functioning correctly and mentioned that Patrick had left some comments on the issue. - [PLAY @7:30](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=450.92)
|
|
|
|
* **Leo Snapshot Bug Fix** - Leo is discussing a bug in the code and seeking input from others. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=482.203118)
|
|
|
|
* The team discussed the possibility of making a SEC reticle and including it in the 04A production, but they were unsure about the snapshot tactics. They also considered pushing back the deployment date for 04A to the first week of December to accommodate the Thanksgiving and winter holidays. - [PLAY @8:37](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=517.0)
|
|
|
|
* **O4b Team Gannt** - Leo and Shomik discussed the deployment planning and transition of responsibilities for the OB team. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=745.432023)
|
|
|
|
* Leo and Shio discussed restructuring the Westicle agenda items, including topics like GWTC, management software, IMBH search, optimizer, and computing. Shio edited the agenda template based on the items discussed in the Friday meeting with the 04B team. - [PLAY @12:58](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=778.66)
|
|
|
|
* **Announcements** - Leo and Shio discussed restructuring the Westicle agenda items and editing the agenda template. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=845.187747)
|
|
|
|
* Leo and Rebecca discussed the possibility of providing quick updates on topics such as depression, low latency, and CV separation. Rebecca agreed to update on these topics during the week. - [PLAY @14:37](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=877.84)
|
|
|
|
* **Last East Call** - Leo mentioned the need for updates on headers, depression, low latency, and CV separation. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=896.514927)
|
|
|
|
* Rebecca mentioned that there were some issues with Charlie's idle jobs last week, but they seemed to have resolved themselves by Friday or Saturday. There were also some spikes in errors, but they were not investigated further and have not been noticed since then. - [PLAY @15:33](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=933.84)
|
|
|
|
* **Updates - Operations - CBC** - Rebecca and Leo discuss recent alerts and errors, but did not investigate them thoroughly. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1016.159773)
|
|
|
|
* Leo requested Prathamesh to test the attribute "useBanki square" in an online job to understand why it was set to zero in the distats file. Leo also asked for a key check on the correlation between the high school and the uploaded events in the MVC. - [PLAY @17:27](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1047.78)
|
|
|
|
* **Updates - O4 Dev - O4B Online** - Prathamesh and Shomik discuss the impact of a certain attribute on the Inspiral jobs. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1333.42644)
|
|
|
|
* **Updates - O4 Dev - GWTC** - Leo wants Prathamesh to perform a key check and mentions testing a GWT-C management API. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1382.615373)
|
|
|
|
* Divya discussed implementing the Sisman rule and investigating the possibility of applying a gosh in fifth. Leo mentioned adjusting the standard deviation using Superman's rule, while Chad expressed skepticism about the current standard deviation value. They agreed to discuss further offline. - [PLAY @23:39](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1419.6)
|
|
|
|
* **Updates - O4 Dev - LR** - The call discussed the calculation of standard deviation and initializing data with caution. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1620.633574)
|
|
|
|
* Victoria and Leo discussed the possibility of switching the session to injection streaming, which Rachel was supposed to bring later. They agreed that it sounded like a good idea. - [PLAY @27:31](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1651.14)
|
|
|
|
* **Updates - O4 Dev - Injection File** - The team discussed resolving waveform discrepancy and potential restructuring of sessions. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1666.223465)
|
|
|
|
* Divya, Leo, and Cody discussed testing and merging a configuration, organizing documentation, and working on offline injection re-rank. They planned to meet the next day to discuss further and Cody mentioned having a patch ready for review by the end of the week. - [PLAY @28:23](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1703.46)
|
|
|
|
* **Updates - O4 Dev - Offline** - Leo and Cody discuss progress on a patch for offline injection re-rank integration. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1787.442616)
|
|
|
|
* Prathamesh, Cody, and Chad discussed the progress and plans for the SNR optimizer project. They aimed to implement the optimizer to whiten data and templates in real-time, ensuring low latency for uploads and improving the overall efficiency of the system. - [PLAY @30:17](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=1817.74)
|
|
|
|
* **Updates - O4 Dev - SNR** - Chad, Prathamesh, Leo, and Divya discuss data discovery, latency reduction, and progress updates. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=2331.786926)
|
|
|
|
* Divya and Shomik discussed various topics including computing, exploratory reading, miscellaneous projects, and a focus session on offer performance plans. Shomik requested a statement for a car, although it was unlikely to be used, to clarify what they wanted to include in it. - [PLAY @39:45](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=2385.66)
|
|
|
|
* **Updates - Misc** - The call discussed using a Statement for car and the suggestion to use the SNR optimizer for events. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=2430.610403)
|
|
|
|
* Divya, Chad, Cody, and Jolien discussed the potential risks and benefits of implementing S. Optimizer and KAGRA data in the GSDL pipeline. They agreed to bring up the topic in the upcoming meeting and suggested setting up a parallel analysis in GraceDB test to evaluate the usefulness of the data before making any changes to the pipeline. - [PLAY @41:04](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=2464.66)
|
|
|
|
* Shomik, Divya, Cody, and Chad discussed the plan for Kagravas to come on with the other three detectors and then switch off to estimate their ranges. They also expressed concerns about the sensitivity, potential issues with Virgo, and the need to check and communicate about the data analysis process. - [PLAY @48:11](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=2891.74)
|
|
|
|
* **AOB - KAGRA Data** - Divya and Shio discussed analyzing data and agreed to provide a response by Friday. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3152.355155)
|
|
|
|
* Divya and Shio discussed the plan to bring up computing resources and inhuman power for running parallel analysis with Kip and Kip's team. They agreed that it sounded good and then moved on to the focus session on the battle for B deployment. - [PLAY @53:11](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3191.64)
|
|
|
|
* The team discussed their plan for upcoming MDCs, including running analysis on Nemo and ICTS, testing new features, and preparing for the engineering run. They also debated whether to run O4B analysis on O4A data or create a separate folder, with Prathamesh preferring the latter for easier identification of data. - [PLAY @53:49](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3229.26)
|
|
|
|
* **Focus - O4B Production Plan** - Prathamesh suggests a faster O4B analysis solution and Divya and Chad agree with it. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3706.460319)
|
|
|
|
* Chad and Shomik discussed the need to include specific bank regions, such as all sky, in the milestone names for different analyses. Shomik agreed to make the necessary changes based on Chad's suggestion. - [PLAY @1:02:18](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3738.8)
|
|
|
|
* Divya asked if there was anything else to discuss, but Prathamesh mentioned not having planned anything for the review session. However, he decided to continue with the ASMR Optimizer Review and Divya handed over the responsibility to him. - [PLAY @1:03:18](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3798.78)
|
|
|
|
* Prathamesh, Jolien, and Chad discussed the Kafka message settings and the Kafka plumbing for catching uploads in the SNR optimizer. They also reviewed the G-streamer pipeline and discussed the optimization process, including the blocking and parallel processing of optimizer jobs. - [PLAY @1:04:23](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=3863.68)
|
|
|
|
* Jolien and Prathamesh discussed the optimization process and the handling of messages in the system. They considered factors such as message consumption, message flooding, and the importance of maintaining the same parameters in the output as in the input. - [PLAY @1:16:19](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=4579.8)
|
|
|
|
* Jolien and Prathamesh discussed the issue of false alarms occurring when events were above the fire threshold, leading to the uploading of lower S&R optimized events. They also considered the probability of a real gravitational wave event happening within a few minutes of an hour boundary while no processing was taking place. - [PLAY @1:29:50](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=5390.5)
|
|
|
|
* **Extra - SNR Review - Kafka** - 1 in 20 gravitational wave events occur when no processing is happening, requiring 10 workers. - [WATCH (30 secs)](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=5604.883346)
|
|
|
|
* Jolien and Prathamesh discussed how they rarely get more than one or two of something per hour, which Jolien found unimpressive. However, Jolien had to leave shortly after the conversation. - [PLAY @1:34:00](https://fathom.video/share/hDQehXurZxwki2_RT7y33zAywxwLeXff?timestamp=5640.62) |