GWDataFind Server issueshttps://git.ligo.org/computing/gwdatafind/server/-/issues2022-07-21T14:10:11Zhttps://git.ligo.org/computing/gwdatafind/server/-/issues/16Add sentry integration for error tracking2022-07-21T14:10:11ZDuncan Macleodduncan.macleod@ligo.orgAdd sentry integration for error trackingTo improve tracking of errors with gwdatafind server instances, we should consider implementing [integration with sentry](https://docs.sentry.io/platforms/python/guides/flask/).To improve tracking of errors with gwdatafind server instances, we should consider implementing [integration with sentry](https://docs.sentry.io/platforms/python/guides/flask/).https://git.ligo.org/computing/gwdatafind/server/-/issues/24filter preference not being used2023-11-14T14:03:15ZMichael Thomasfilter preference not being usedqueries to the datafind server `gwdatafind-server-1.2.2-1.el8.noarch` are not returning files in the preferred order. Here is the preferencs in /etc/gwdatafind-server.ini:
```
filter_preference = """{ '^file' : ['/ceph', '/scratch','...queries to the datafind server `gwdatafind-server-1.2.2-1.el8.noarch` are not returning files in the preferred order. Here is the preferencs in /etc/gwdatafind-server.ini:
```
filter_preference = """{ '^file' : ['/ceph', '/scratch','/archive'], '^gsiftp' : ['/ceph','/scratch','/archive']}"""
```
...and here is the output from a gwdatafind query:
```
$ gw_data_find -r datafind.ldas.ligo-la.caltech.edu:80 -f L-L1_HOFT_C00-1366667264-4096.gwf
file://localhost/archive/frames/ER15/hoft_C00/L1/L-L1_HOFT_C00-136/L-L1_HOFT_C00-1366667264-4096.gwf
file://localhost/ceph/frames/ER15/hoft_C00/L1/L-L1_HOFT_C00-136/L-L1_HOFT_C00-1366667264-4096.gwf
```
I expected that the /ceph path would show up before the /archive path.https://git.ligo.org/computing/gwdatafind/server/-/issues/26Remove support for X.509 certificates2023-06-16T10:51:23ZDuncan Macleodduncan.macleod@ligo.orgRemove support for X.509 certificatesLIGO.ORG X.509 is end-of-life in 2025 (see computing&25+), prior to that time, this service should (gracefully) remove support for X.509.LIGO.ORG X.509 is end-of-life in 2025 (see computing&25+), prior to that time, this service should (gracefully) remove support for X.509.2025-03-01https://git.ligo.org/computing/gwdatafind/server/-/issues/33Refactor configuration to use multiple sections2024-03-15T17:24:11ZDuncan Macleodduncan.macleod@ligo.orgRefactor configuration to use multiple sectionsCurrently the configuration file is a monolith in a single section `[GWDataFindServer]`, as a legacy of this being part of a larger application.
We should refactor the configuration file parsing to enable multiple sections for
```ini
[...Currently the configuration file is a monolith in a single section `[GWDataFindServer]`, as a legacy of this being part of a larger application.
We should refactor the configuration file parsing to enable multiple sections for
```ini
[auth]
authorization = scitokens
[cache]
path = /var/lib/diskcache/ascii_cache.dat
timeout = 10
[scitokens]
issuer = https://cilogon.org/igwn
audience = TEST
scope = gwdatafind.read
[x509]
gridmap = /etc/security/grid-mapfile
timeout = 60
[filter]
site_include_pattern =
site_exclude_pattern =
frametype_include_pattern =
frametype_exclude_pattern =
filter_preference = """<>"""
[osdf test]
...
```
This should hopefully make things more flexible, and easier to document.https://git.ligo.org/computing/gwdatafind/server/-/issues/35Add support for ingesting multiple data sources2023-11-14T15:41:49ZDuncan Macleodduncan.macleod@ligo.orgAdd support for ingesting multiple data sourcesCurrently a single gwdatafind server can only serve URLs from a single data source, in practice a single diskcache instance. It may be useful to hook up multiple diskcache sources to a single gwdatafind server instance.
This would requi...Currently a single gwdatafind server can only serve URLs from a single data source, in practice a single diskcache instance. It may be useful to hook up multiple diskcache sources to a single gwdatafind server instance.
This would require rearchitecting the `cache.py` module to spawn multiple threads to scan multiple sources, or similar.https://git.ligo.org/computing/gwdatafind/server/-/issues/39Enable CIT AP issuer on production GWDataFind server2024-03-20T16:18:15ZJosh WillisEnable CIT AP issuer on production GWDataFind serverSince the tests in #37 were successful, I would like to request that the CIT app issuer, `https://osdf.igwn.org/cit`, be added as an accepted issuer of tokens on the production GWDataFind server.Since the tests in #37 were successful, I would like to request that the CIT app issuer, `https://osdf.igwn.org/cit`, be added as an accepted issuer of tokens on the production GWDataFind server.Duncan Macleodduncan.macleod@ligo.orgDuncan MeacherDuncan Macleodduncan.macleod@ligo.org