|
|
|
# Next Generation Data Delivery
|
|
|
|
|
|
This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim of which is to develop a low-latency data distribution and stream processing platform to meet the needs of real-time searches for gravitational waves.
|
|
This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim of which is to develop a low-latency data distribution and stream processing platform to meet the needs of real-time searches for gravitational waves.
|
|
|
|
|
... | @@ -14,9 +15,22 @@ This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim |
... | @@ -14,9 +15,22 @@ This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim |
|
- [Materialize](https://docs.google.com/presentation/d/1F0l7TKwxD4BHX4JHTXBIywApURG-OA7VRmUjlbtGi_U/edit?usp=sharing)
|
|
- [Materialize](https://docs.google.com/presentation/d/1F0l7TKwxD4BHX4JHTXBIywApURG-OA7VRmUjlbtGi_U/edit?usp=sharing)
|
|
- [Materialize/ClickHouse](https://docs.google.com/presentation/d/1D0Kyg694PlKnOgHIK2lJJvAHR4aWju9xGolUWwOHG7U/edit?usp=sharing)
|
|
- [Materialize/ClickHouse](https://docs.google.com/presentation/d/1D0Kyg694PlKnOgHIK2lJJvAHR4aWju9xGolUWwOHG7U/edit?usp=sharing)
|
|
|
|
|
|
|
|
## technologies
|
|
|
|
|
|
|
|
Links to technologies being considered:
|
|
|
|
|
|
|
|
- [gRPC](https://grpc.io/)
|
|
|
|
- [Arrow](https://arrow.apache.org/)
|
|
|
|
- [Arrow Flight](https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/)
|
|
|
|
- [Kafka](https://kafka.apache.org/)
|
|
|
|
- [influxDB](https://www.influxdata.com/)
|
|
|
|
- [gstreamer RTP/RTSP](https://gstreamer.freedesktop.org/documentation/additional/rtp.html?gi-language=c)
|
|
|
|
- [consul](https://www.consul.io/)
|
|
|
|
|
|
## applications
|
|
## applications
|
|
|
|
|
|
|
|
Links to resources about applications that will use the system in LIGO.
|
|
|
|
|
|
- [low-latency application table](https://docs.google.com/spreadsheets/d/15JzZ1KEHscwXhny8L0lxZIYXkiv6LlkCgSLi_Iuruyw/edit#gid=1412826968)
|
|
- [low-latency application table](https://docs.google.com/spreadsheets/d/15JzZ1KEHscwXhny8L0lxZIYXkiv6LlkCgSLi_Iuruyw/edit#gid=1412826968)
|
|
- [open public alerts application table (searches)](https://docs.google.com/spreadsheets/d/1kLO84LNSj6B_PTlB35ujh-uYxXLdFc7L4P2lxY1-KXc/edit#gid=1943285589)
|
|
- [open public alerts application table (searches)](https://docs.google.com/spreadsheets/d/1kLO84LNSj6B_PTlB35ujh-uYxXLdFc7L4P2lxY1-KXc/edit#gid=1943285589)
|
|
|
|
|
... | @@ -25,8 +39,3 @@ This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim |
... | @@ -25,8 +39,3 @@ This is the home of LIGO's Next Generation Data Delivery (NGDD) project, the aim |
|
- [
|
|
- [
|
|
The next generation of low-latency data distribution and stream processing for LIGO
|
|
The next generation of low-latency data distribution and stream processing for LIGO
|
|
](https://dcc.ligo.org/LIGO-G2200571) |
|
](https://dcc.ligo.org/LIGO-G2200571) |
|
|
|
|
|
## resources
|
|
|
|
|
|
|
|
- [gstreamer RTP/RTSP](https://gstreamer.freedesktop.org/documentation/additional/rtp.html?gi-language=c)
|
|
|
|
- [consul](https://www.consul.io/) |
|
|
|
\ No newline at end of file |
|
|