Skip to content

Adapt the partitioning response to stream smaller chunks of channels.

Jonathan Hanks requested to merge jonathan-hanks/arrakis-server:issue18_streaming_partitioning_metadata into main
  • Instead of sending all the channels back in a single large RecordBatch, break it up into a series of smaller RecordBatches.
  • Initial size is 1000 channels.
  • This is to deal with issues seen with the rust client when a single large RecordBatch is used for the response.

Closes #18 (closed)

Merge request reports