Kafka alert generator

Addresses #388 (closed), and depends on !851 (merged).

Feb 11 edit: First attempt at adding the code to publish to a kafka topic is done, needs testing. Alerts currently set to publish to StandinKafkaTopic

Aug 10 edit: Ready to be reviewed. Need new release of hop-client for a PR needed for GCN support (merged) and need to update URL of avro schema files once userguide!124 (merged) is merged.

Sep 21 edit: Peeled a lot of these changes off into other MRs, specifically !914 (merged), !915 (merged), and !917 (merged). This MR now primarily deals with the work needed to plug the kafka alerts into the orchestrator.

To-Do list:

• Test sending avro packet to kafka producer
• Decide where to store avro schema files for deployed instances to read
• Write unit tests to...
  • Validate that avro packet constructed by voevent is correct
  • Check that avro packet is sent to kafka producer

gwcelery/kafka/bootsteps.py

@@ -49,6 +49,15 @@ class Producer(KafkaBootStep):
             k: stream.open(v, 'w') for k, v in
             consumer.app.conf['kafka_urls'].items()
         }
+        # Set up flag for status of kafka broker, this will be checked by a
+        # periodic task
+        consumer.app.conf['kafka_topic_up'] = {
+            v: True for v in consumer.app.conf['kafka_urls'].values()
+        }
+        # Set up flag for failed delivery of messages
+        consumer.app.conf['kafka_delivery_failures'] = {
+            v: False for v in consumer.app.conf['kafka_urls'].values()
+        }
 
     def stop(self, consumer):
         super().stop(consumer)