Skip to content

Kafka Client overhaul

Patrick Godwin requested to merge kafka_client_overhaul into master

This PR makes some overhauls to the Kafka client, allowing it to be used to query and store metrics. This is a rewrite of the Reporter to a Client. Besides the name change, the API is cleaner and it switches to the confluent-kafka client rather than kafka-python. In addition, scald aggregate now uses this new client.

Besides these changes, I have fixed two auxiliary issues:

  • Add a zip_safe flag in setup.py to avoid this ZipImportError when re-installing a package from source.
  • Change where utf-8 encoding is done for the influx line protocol, which caused an issue combining results from storing multiple lines in python 3.

Merge request reports