Overview
Dremio 24.2+ includes the functionality to download logs and other diagnostics information from the Dremio UI. In a Kubernetes deployment using the provided Dremio Helm charts, this will be limited to collection from the master-coordinator. The attached YAML files can be set as templates to allow collection from executors as well.
Applies To
Dremio 25.1+ and later releases deployed in Kubernetes using the Helm charts at https://github.com/dremio/dremio-cloud-tools/charts/dremio_v2.
Details
To allow coordinator access to the Kubernetes API, so that it can access executors to collect diagnostics, it’s necessary to create a service account to launch the coordinator with if one is not in use, and to create a role and clusterRole with the necessary privileges, then role binding that connects the role to the service account.
Attached to this article are 2 files. One is a service account template yaml file named coordinator-service-account.yaml
that will create a service account, using the name set in the values.yaml
for the coordinator.serviceAccount
parameter. The other is diagnostics-roles.yaml
which creates a role and a clusterRole both named ddc-collect
with the correct privileges and binds them to the coordinator service account set in values.yaml
.
To deploy:
- (If you already use a service account for your coordinator you may skip this step.) Edit the values file. Under the
coordinator
heading, find the following block, uncomment “serviceAccount:” and set the desired service account name.
# Kubernetes Service Account
# Uncomment below to use a custom Kubernetes service account for the coordinator.
#serviceAccount: ""
- Place the attached files in the
templates
folder of the Dremio Helm charts. If you are already using a service account, you only need to placediagnostics-roles.yaml
. - Run
helm upgrade
orhelm install
as needed to deploy the new account and roles attached to the coordinator.
Further Reading
https://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/
https://kubernetes.io/docs/reference/access-authn-authz/rbac/
https://docs.dremio.com/current/sonar/monitoring/#retrieving-logs-from-the-dremio-console-enterprise