Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
G
gracedb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 100
    • Issues 100
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
    • Iterations
  • Merge Requests 1
    • Merge Requests 1
  • Requirements
    • Requirements
    • List
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • CI/CD
    • Code Review
    • Insights
    • Issue
    • Repository
    • Value Stream
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • lscsoft
  • gracedb
  • Issues
  • #158

Closed
Open
Created Jun 07, 2019 by Jonah Kanner@jonah-kanner🤓

Gracedb should parse FITS files

Description of feature request

Add some parsing of FITS files included in VOEvents into gracedb. This could be done at the time a voevent is created, or later by a cronjob. There are several outcomes that people have suggested for this:

  • Create PNG of 2-D skymaps
  • Create PNG of 3-D skymaps
  • Create PNG of p-astro info
  • Ingest distance info into schema of each voevent

Use cases

  • Could display PNG of skymaps with predictable and reliable filename
  • Could enhance views of gracedb events to show these PNGs in a structured way
  • Could include distance info in tables listing sets of events, so that people could sort or filter based on this property

Benefits

Currently, the PNG files are not uploaded with predictable names, and so are not useful. This would allow PNG files to be more reliable and useful in views. Adding distance info to schema would allow people to search and sort by distance.

Drawbacks

  • Distance information includes 2 numbers, so represents a significant change to the schema for VOEvents
  • If this ingestion is done at the time a new VOEvent is created, could slow down the process of sending out GCNs, which is a serious drawback. For this reason, may be better to create the VOEvent in the database without this, and then 'back-fill' with a cronjob or similar.

Suggested solutions

If it were me, I would:

  • Add a distance and distance error field to the VOEvent schema. These fields would be 'null' at the time of VoEvent creation, and would not appear in the VoEvent XML files (as now).
  • Set up a cronjob that runs every 10 minutes or so, and does the following:
  • Gets a list of all VOEvents where the distance column is 'null'
  • For each of these, generate PNG images of skymaps, and save to disk in a predictable location
  • Read out distance information from FITS header, and ingest into database.
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information
Assignee
Assign to
None
Milestone
None
Assign milestone
Time tracking
None
Due date
None