Skip to content
Snippets Groups Projects
Commit 8b9d5e51 authored by Patrick Godwin's avatar Patrick Godwin
Browse files

gstlal_kafka_dag: add env script generation for kafka env variables

parent db9ce4ed
No related branches found
No related tags found
No related merge requests found
Pipeline #51585 failed
......@@ -79,6 +79,12 @@ zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0
"""
KAFKA_ENV_TEMPLATE = """
KAFKA_JVM_PERFORMANCE_OPTS="-server -XX:MetaspaceSize=96m -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:G1HeapRegionSize=16M -XX:MinMetaspaceFreeRatio=50 -XX:MaxMetaspaceFreeRatio=80"
KAFKA_HEAP_OPTS="-Xms8G -Xmx8G"
export KAFKA_HEAP_OPTS KAFKA_JVM_PERFORMANCE_OPTS
"""
#
# job classes
#
......@@ -203,4 +209,10 @@ print('making DAG...')
dag.write_dag()
dag.write_script()
print('making env script...')
with open('kafka.env', 'w') as f:
f.write(KAFKA_ENV_TEMPLATE)
print('source kafka env with: source kafka.env')
print('launch DAG with: condor_submit_dag kafka_broker.dag')
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment