When streaming metadata for partitioning we should be able to send things in smaller chunks

In testing partitioning with large channel values we have seen issues where the Rust flight client fails when a sufficiently large record batch is returned from the server.

In testing this was a block with 74000 rows. Though it is not known if it is row count, total record batch size, ... that actually triggers the issue. This results in a stream that the rust flight client sees as a stream of errors.

If we switch things to stream smaller blocks this should be alleviated.

Though this may be an issue in other arenas.