|
|
|
This page is intended to describe the on-the-wire schema for the new NGDD protocol.
|
|
|
|
|
|
|
|
## Overview
|
|
|
|
# Overview
|
|
|
|
|
|
|
|
The plan is to use Apache Arrow Flight (gRPC + protobuf).
|
|
|
|
We're evaluating various protocols
|
|
|
|
|
|
|
|
| protocol | description | pros | cons | python | C/C++ | browser | java |
|
|
|
|
| ------ | ------ | ------ | ------ | ------ | ------ | ------ | ------ |
|
|
|
|
| arrow flight | gRPC+protobuf (see below) | nice protocol | heavy library dependencies | yes | yes | poor | ? |
|
|
|
|
| HTTP+[JSON] | simple HTTP with some common serialization (e.g. JSON) | very portable | less sophisticated? | yes | yes | yes | yes |
|
|
|
|
|
|
|
|
|
|
|
|
## Arrow Flight
|
|
|
|
|
|
|
|
One of the protocols we're considering is Apache Arrow Flight (gRPC + protobuf).
|
|
|
|
|
|
|
|
The schema will be determined on the fly based on the client request:
|
|
|
|
|
| ... | ... | |
