Skip to content
Snippets Groups Projects
Commit 1e6b8d69 authored by Chad Hanna's avatar Chad Hanna
Browse files

update replay page

parent 6ec99547
No related branches found
No related tags found
No related merge requests found
......@@ -2,6 +2,8 @@
[TOC]
\section Introduction Introduction
With O1 quickly approaching in mid to late 2015, the CBC group is doing a live
......@@ -9,20 +11,28 @@ data simulation run using S6 data to test piplines for the purpose of review.
This documentation page is specific to the gstlal portion of the simulation
run.
\subsection Goals Goals
- Establish the accuracy of False Alarm Rate/False Alarm Probability (FAR/FAP) calculations in online analysis for low mass systems
- Establish the online analysis has the appropriate sensitivity
- Ensure that the information provided to gracedb for events is sufficient for EM alerts and for collaboration consumption.
\subsection Proposal Proposed Approach
The gstlal analysis team proposes to use one month of S6 data replayed in an
online environment. Details can be found
<a href="https://www.lsc-group.phys.uwm.edu/ligovirgo/cbcnote/S6VSR3ReplayMDC/140812103550GeneralData%20broadcasting">here</a>
\section Data One Month Data Details
Some quick facts:
- Data GPS Start: 968543943 -> 1120766224
......@@ -34,25 +44,31 @@ Some quick facts:
\subsection Resources Resources
- Online: 96 HT cores (48 physical cores) on three nodes: execute1000, execute1001, execute1002
- Offline: CIT Cluster (does not need to be as specific as online)
\subsection AnalysisCodes Analysis Codes
- gstlal: 7466e2bfe87adef273574e9068eced0be683dc9a
- lalsuite: 3dc971a085afdbf06b44fb463ed08036270bf377
\subsection Injections Injection Parameters
- Component mass normally distributed with mean mass of 1.4 \f$M_\odot\f$ and standard deviation of 0.01 \f$M_\odot\f$
- Sources uniformly distributed in interval [5,45] Mpc
- Spinless
- Injected every 20 &plusmn; 3 seconds
- https://www.lsc-group.phys.uwm.edu/ligovirgo/cbcnote/Software%20Online%20injections#injections_parameters
\subsection Online Online Analysis
\subsubsection OnlineBanks Template Banks
- /home/gstlalcbc/review/s6replay/online/bank
......@@ -63,14 +79,18 @@ Some quick facts:
- /home/gstlalcbc/review/s6replay/online/trigs
- <a href=https://ligo-vcs.phys.uwm.edu/cgit/gstlal/tree/gstlal-inspiral/share/Makefile.s6_replay_online>Makefile to make the analysis dag</a>
\subsection Offline Offline Analysis
- At CIT
- /home/gstlalcbc/s6replay_bigdog/offline_one_month_no_stochastic_injections
- <a href=https://ligo-vcs.phys.uwm.edu/cgit/gstlal/tree/gstlal-inspiral/share/Makefile.s6_replay> Makefile </a>
\subsection Results Results
- <a href=https://ldas-jobs.cgca.uwm.edu/~gstlalcbc/cgi-bin/gstlalcbcsummary> Online Status Page </a>
- <a href="https://ldas-jobs.cgca.uwm.edu/~gstlalcbc/online-test/ALL_LLOID_COMBINED_openbox.html">Online Summary Page</a>
- <a href="https://gracedb.ligo.org/events/search/?query=test%20gstlal%20lowmass%201122174187..1124174187">GraceDb query</a>
......@@ -78,7 +98,8 @@ Some quick facts:
- <a href="https://ldas-jobs.ligo.caltech.edu/~gstlalcbc/offline_s6_replay_1monrun/">Offline Analysis Page</a>
\subsection status Status As Of July 31
\subsection status Status As Of August 4
\subsubsection nagios Nagios Monitor
......@@ -88,44 +109,48 @@ https://dashboard.ligo.org/
-- Submitter: pcdev3.nemo.phys.uwm.edu : <192.168.5.3:41523> : pcdev3.nemo.phys.uwm.edu
ID OWNER SUBMITTED RUN_TIME ST PRI SIZE CMD
1708701.0 gstlalcbc 7/28 22:02 2+10:32:54 R 0 0.3 condor_dagman -f -
1708708.0 gstlalcbc 7/28 22:02 2+10:32:36 R 0 0.0 gstlal_inspiral_ma
1708709.0 gstlalcbc 7/28 22:02 2+10:32:36 R 0 0.0 gstlal_ll_inspiral
1708710.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 9765.6 gstlal_inspiral --
1708711.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 7324.2 gstlal_inspiral --
1708712.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 9765.6 gstlal_inspiral --
1708713.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 7324.2 gstlal_inspiral --
1708714.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 9765.6 gstlal_inspiral --
1708715.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 7324.2 gstlal_inspiral --
1708716.0 gstlalcbc 7/28 22:02 2+10:32:21 R 0 7324.2 gstlal_inspiral --
1708717.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708718.0 gstlalcbc 7/28 22:03 2+10:32:21 R 0 7324.2 gstlal_inspiral --
1708719.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708720.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 9765.6 gstlal_inspiral --
1708721.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708722.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708723.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708724.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 9765.6 gstlal_inspiral --
1708725.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 7324.2 gstlal_inspiral --
1708726.0 gstlalcbc 7/28 22:03 2+10:32:20 R 0 9765.6 gstlal_inspiral --
1708727.0 gstlalcbc 7/28 22:03 2+10:31:55 R 0 7324.2 gstlal_inspiral --
1708728.0 gstlalcbc 7/28 22:03 2+10:31:54 R 0 7324.2 gstlal_inspiral --
1708729.0 gstlalcbc 7/28 22:03 2+10:31:55 R 0 7324.2 gstlal_inspiral --
1708730.0 gstlalcbc 7/28 22:03 2+10:31:54 R 0 9765.6 gstlal_inspiral --
1708731.0 gstlalcbc 7/28 22:03 2+10:31:54 R 0 9765.6 gstlal_inspiral --
1708732.0 gstlalcbc 7/28 22:03 2+10:31:54 R 0 9765.6 gstlal_inspiral --
1708733.0 gstlalcbc 7/28 22:03 2+10:31:54 R 0 9765.6 gstlal_inspiral --
1708735.0 gstlalcbc 7/28 22:03 2+10:32:05 R 0 0.0 lvalert_listen --u
1714098.0 gstlalcbc 7/30 08:27 1+00:08:29 R 0 0.0 gstlal_ll_inspiral
1708701.0 gstlalcbc 7/28 22:02 5+09:05:39 R 0 0.3 condor_dagman -f -
1708708.0 gstlalcbc 7/28 22:02 5+09:05:21 R 0 0.0 gstlal_inspiral_ma
1708711.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 7324.2 gstlal_inspiral --
1708712.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 9765.6 gstlal_inspiral --
1708713.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 7324.2 gstlal_inspiral --
1708714.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 9765.6 gstlal_inspiral --
1708715.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 7324.2 gstlal_inspiral --
1708716.0 gstlalcbc 7/28 22:02 5+09:05:06 R 0 9765.6 gstlal_inspiral --
1708717.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 7324.2 gstlal_inspiral --
1708719.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 7324.2 gstlal_inspiral --
1708721.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 7324.2 gstlal_inspiral --
1708722.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 9765.6 gstlal_inspiral --
1708723.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 9765.6 gstlal_inspiral --
1708725.0 gstlalcbc 7/28 22:03 5+09:05:05 R 0 9765.6 gstlal_inspiral --
1708727.0 gstlalcbc 7/28 22:03 5+09:04:40 R 0 9765.6 gstlal_inspiral --
1708729.0 gstlalcbc 7/28 22:03 5+09:04:40 R 0 9765.6 gstlal_inspiral --
1708731.0 gstlalcbc 7/28 22:03 5+09:04:39 R 0 9765.6 gstlal_inspiral --
1708733.0 gstlalcbc 7/28 22:03 5+09:04:39 R 0 9765.6 gstlal_inspiral --
1708735.0 gstlalcbc 7/28 22:03 5+09:04:50 R 0 0.0 lvalert_listen --u
1714098.0 gstlalcbc 7/30 08:27 3+22:41:14 R 0 0.0 gstlal_ll_inspiral
1717602.0 gstlalcbc 7/31 20:43 2+10:24:48 R 0 0.0 gstlal_ll_inspiral
1717610.0 gstlalcbc 7/31 22:02 2+09:06:00 R 0 7324.2 gstlal_inspiral --
1717643.0 gstlalcbc 8/1 03:00 2+04:07:52 R 0 9765.6 gstlal_inspiral --
1717652.0 gstlalcbc 8/1 04:57 2+02:11:08 R 0 9765.6 gstlal_inspiral --
1717653.0 gstlalcbc 8/1 04:58 2+02:09:38 R 0 9765.6 gstlal_inspiral --
1717669.0 gstlalcbc 8/1 07:37 1+23:31:13 R 0 7324.2 gstlal_inspiral --
1717671.0 gstlalcbc 8/1 07:37 1+23:30:28 R 0 9765.6 gstlal_inspiral --
1717820.0 gstlalcbc 8/1 16:08 1+14:59:47 R 0 7324.2 gstlal_inspiral --
1717823.0 gstlalcbc 8/1 16:23 1+14:44:48 R 0 9765.6 gstlal_inspiral --
\section Review Review
\subsection day1 July 29, 2015
In attendance: Chad, Edward Maros, Gareth Tomas, Jolien Creighton, Kent Blackburn, Laleh Sadeghian, Les Wade, Maddie Wade, Sathyaprakash, Sarah Caudill, Tjonnie Li
\subsubsection day1news News
\subsubsection day1actions Actions
......@@ -134,7 +159,7 @@ In attendance: Chad, Edward Maros, Gareth Tomas, Jolien Creighton, Kent Blackbur
- If possible label on the contours on the background plots
- Money plot here looks strange (dominated by priors, insufficient data, ...);
it would be good if release versions can fix this:
it would be good if release versions can fix this:
<https://ldas-jobs.cgca.uwm.edu/~gstlalcbc/online-test/Images/H1L1V1-GSTLAL_INSPIRAL_PLOTSUMMARY_ALL_LLOID_COMBINED_05_count_vs_ifar_openbox-1121652724-550359.png>.
One issue is that the clustering used in gstlal_inspiral internally in online
running is set by the parameter "thinca-interval", which we usually set to 1
......@@ -145,8 +170,8 @@ approximate the gstlal_inspiral internal clustering well enough. See:
88cebe1656e267fd9d6579db83e4cdfff00c804e. This was not however sufficient to
fix the IFAR plot. I still think that this is simply due to the fact that there
has not been sufficient data to overwhelm the very conservative prior. Lets
see if the situation improves as we go forward.
see if the situation improves as we go forward. For more information on our
KDE see: https://dcc.ligo.org/G1500589
\subsubsection day1completed Completed Actions
......@@ -161,11 +186,15 @@ see if the situation improves as we go forward.
- Use a smoothing kernel with a larger (try 2, 4) scale to smoothen the likelihood and probability plots. This has been investigated and is documented here: https://bugs.ligo.org/redmine/issues/2339
\subsection day2 July 30, 2015
In attendance: Chad, Jolien and Sathya
\subsubsection day2news News
- *Big Dog was detected the night before*
\subsubsection day2actions Actions
- Look at missed close-by injections (there are not many but it is puzzling why ~8 Mpc injections are missed; could be due to injections being on lock-loss boundary but should be investigated).
......@@ -174,5 +203,93 @@ In attendance: Chad, Jolien and Sathya
- The SNR heat plot and the SNR-Chisquare trigger plots do not appear in SIM-DB page; it would be good to have them there too to compare with the Big Dog event and to see if the anatomy of the triggers is similar when there is a loud event.
\subsubsection day2completed Completed Actions
\subsection day3 July 31, 2015
In attendance: Chad, Sathya
from Sathya:
- We discussed the result of applying a kernel that uses a larger scale and you
found that using a uniformly large scale degrades the sensitivity even in
regions where you already have enough triggers to measure the ranking statistic
accurately. Showed how a trigger density-dependent (I think you called
it dynamic) scaling would work and I am happy with the outcome.
- I would like to invite the other reviewers to look the results of applying the two different kernels and see if they are happy. We should review your patch to make sure there is nothing obviously wrong and we can do that when there are at least two reviewers present.
- You also pointed out that the online webpage IFAR plots were actually still "biased" with respect to the prediction (as opposed to what you erroneously showed us yesterday, which seemed to show them to have converged); but it is now less biased than two days ago, hopefully the measured IFAR will converge to the predicted one soon.
\subsubsection day3news News
\subsubsection day3actions Actions
- The only action item is for the BBH group to use your patch for the ranking statistic and rerun to see if the new kernel causes any problem. We both agreed that you would need to test the kernel for a while before pushing the change to O1 release.
- There is an action item also on me to come up with a checklist for us to go through everyday during an online run. I will circulate this before our call tomorrow (BTW when do we meet tomorrow, 10 am Eastern).
\subsubsection day3completed Completed Actions
\subsection day4 August 1, 2015
\subsubsection day4news News
Unfortunately there was a simdb outage causing several injection jobs to fail and currently they are in a flopping state awaiting response from the simdb team. An open question is, should we trap failures such as these?
Traceback (most recent call last):
.............................................................
File "/usr/lib/python2.7/ssl.py", line 305, in do_handshake
self._sslobj.do_handshake()
socket.error: [Errno 104] Connection reset by peer
\subsection day6 August 3, 2015
\subsubsection day6news News
- The simdb outage is over, however there was a substantial downtime for
injection jobs over the weekend. Fortunately the noninjection jobs were not
effected. The outage effected:
- July 31st 20:51:08 CDT (First 500 response.)
- August 1st 16:24:08 CDT (First 200 response.)
- GraceDB uploads have nothing unusual, but we now see one 1 in a million
second event (after roughly 5 day of the run), consistent with what should
be expected after this many days into the run. Here are somethings to think
about:
\subsubsection day6actions Actions
- The IFAR plot has still not converged. It might be a good idea to look at
plots from day to day to figure out the convergence. A similar issue has
been seen in IMBH search; a smaller bias but for the three detector case. The
issue here might be different.
- There have been some SimDB failures; this might cause job crashes when the
job runs out of 'max retry's. NOTE perhaps we should disable uploads of
ranking data. I think that is what filled up the disk.
\subsubsection day6completed Completed Actions
- Inform the rest of the CBC about Replay. Include replay page, GraceDB page,
online status page, online ihope page, offline status page. Added to 8/4 CBC call.
\subsection day7 August 4, 2015
Do we want to consider a cold restart with some action items addressed?
- Get the range vs time (realtime) plot working
- Disable rankind data uploads
- Start with a less aggressive prior to see if FAR converges more quickly.
\subsubsection day7news News
\subsubsection day7actions Actions
\subsubsection day7completed Completed Actions
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment