Fix for Sandboxed installation

Add some needed Fixes:

• Correct errors in "exttrig", "gwskynet", "kafkaconsumer" charts
• Added support for the additional configuration file: /home/gwcelery/.config/gwcelery/kafka_credential_map.json
• Define the ENVIRONMENTAL variables GRACEDB_HOSTNAME, IGWN_HOSTNAME, KAFKA_HOSTNAME to be sure that it would be possible to use minikube configuration file to start any sandboxed installations.
• Add a fix for issue #2 (closed) The name of the queue has been changed

Relates merge request: emfollow/gwcelery!1544 (merged), llai-deploy-sandboxed!21 (merged)

gwcelery/templates/_common.tpl

@@ -43,6 +43,8 @@ livenessProbe:
       chmod 600 /tmp/secrets-copy/auth.toml ;
       cp /tmp/secrets/netrc /tmp/secrets-copy/netrc ;
       chmod 600 /tmp/secrets-copy/netrc ;
+      cp /tmp/secrets/kafka_credential_map /tmp/secrets-copy/kafka_credential_map.json ;
+      chmod 600 /tmp/secrets-copy/kafka_credential_map.json ;
       cp /tmp/secrets/x509up_u1000 /tmp/secrets-copy/x509up_u1000 ;
       chmod 600 /tmp/secrets-copy/x509up_u1000 ;
       cat $(python -m requests.certs) /tmp/ca.crt > /tmp/cabundle/cacerts.pem
@@ -83,6 +85,12 @@ livenessProbe:
 {{- if .Values.gracedbSandboxed.enabled }}
 - name: REQUESTS_CA_BUNDLE
   value: /home/gwcelery/cacerts.pem
+- name: GRACEDB_HOSTNAME
+  value: {{ .Values.publicName }}
+- name: IGWN_HOSTNAME
+  value: {{ printf "kafka://%s" .Values.publicName }}
+- name: KAFKA_HOSTNAME
+  value: {{ printf "kafka://%s" .Values.publicName }}
 {{- end }} 
 - name: LIGO_DATAFIND_SERVER
   value: {{ .Values.ligoDatafindServer }}
@@ -97,6 +105,9 @@ livenessProbe:
 - name: secrets-copy
   mountPath: /home/gwcelery/.config/hop/auth.toml
   subPath: auth.toml
+- name: secrets-copy
+  mountPath: /home/gwcelery/.config/gwcelery/kafka_credential_map.json
+  subPath: kafka_credential_map.json
 - name: secrets-copy
   mountPath: /tmp/x509up_u1000
   subPath: x509up_u1000

[Sara Vallero]

"publicName" is not defined... and we lose generality if we assign the same value to all vars with no possibility to set a value for each.

[Roberto DePietri]

It is defined on the gracedb chart. Now it is in draft status because I do not the best solution to have this configuration and setting the defaults. Try to find a better way for configuring this settings.

[Sara Vallero]

So it will not work... I suggest to remove this change and we can move on merging the other changes that are minor.

[Sara Vallero]

I can work on a MR to make gracedb/igwn endpoints configurable. I'm thinking about preparing a ConfigMap to override the celery config file, as it was originally. I never really liked the idea of hardcoding the config for a specific environment into the source code.

[Sara Vallero]

Ah wait... we already have the possibility to write a custom config. It's the variable "celeryConfig" in values.yaml.