... | ... | @@ -9,10 +9,54 @@ Two ways to register data: |
|
|
register all frames in those times
|
|
|
* offline: select a start time and datatype, register frames as they arrive.
|
|
|
|
|
|
First, we need to set up a `diskcache` daemon.
|
|
|
For this exercise, I will register data directly at CIT and transfer to CNAF.
|
|
|
|
|
|
|
|
|
## DiskCache
|
|
|
Create a configuration file
|
|
|
A diskcache daemon usually runs locally. I'm not sure where that lives (or if
|
|
|
it's true) at CIT, so let's just run our own instance:
|
|
|
|
|
|
Create a configuration file:
|
|
|
```
|
|
|
[jclark@ldas-pcdev6] $ cat diskcache.rsc
|
|
|
SERVER_PORT=11300
|
|
|
CONCURRENCY=4
|
|
|
OUTPUT_ASCII=/home/jclark/Projects/rucio-O3/CNAF/diskcache/frame_cache_dump
|
|
|
OUTPUT_ASCII_VERSION=0x00FF
|
|
|
OUTPUT_BINARY=/home/jclark/Projects/rucio-O3/CNAF/diskcache/.frame.cache
|
|
|
LOG=diskcache
|
|
|
LOG_DIRECTORY=/home/jclark/Projects/rucio-O3/CNAF/diskcache/logs
|
|
|
LOG_DEBUG_LEVEL=0
|
|
|
LOG_ROTATE_ENTRY_COUNT=10000
|
|
|
SCAN_INTERVAL=16000
|
|
|
STAT_TIMEOUT=600
|
|
|
#------------------------------------------------------------------------
|
|
|
# DIRECTORY_TIMEOUT
|
|
|
# Number of seconds to wait for directory calls to complete
|
|
|
# Default: 20 seconds
|
|
|
#------------------------------------------------------------------------
|
|
|
DIRECTORY_TIMEOUT=60
|
|
|
|
|
|
[EXTENSIONS]
|
|
|
.gwf
|
|
|
.sft
|
|
|
|
|
|
[EXCLUDED_DIRECTORIES]
|
|
|
|
|
|
[MOUNT_POINTS]
|
|
|
/archive/frames/ER13/hoft
|
|
|
```
|
|
|
|
|
|
Now start the `diskcache` as a background process. This is easy with a script
|
|
|
like
|
|
|
[this](https://git.ligo.org/james-clark/gwrucio/blob/master/bin/start_diskcache)
|
|
|
[Credit: not sure, but probably Ed Maros]
|
|
|
|
|
|
After a short time, there is an ascii-dump of the frame cache at:
|
|
|
```
|
|
|
/home/jclark/Projects/rucio-O3/CNAF/diskcache/frame_cache_dump
|
|
|
```
|
|
|
|
|
|
|
|
|
## Offline registration
|
|
|
|
... | ... | |