Managed identities with databricks cluster

Question

Can we use managed identities with databricks? What I'm actually trying to achieve is, I have a cluster in databricks, I want it to be able to access secrets or keys stored in an azure key vault.
We generally perform this with VM, by enabling the managed identity and allowing that identity via access policy or Role-based access policy(RBAC) in key vaults.

Can we leverage the concept of manged identities in a similar way with databricks as well? Or is there any other way possible which I can use to access the secrets in key vault from databricks clusters?

P.S. The secret accessed in key vault will be used in init script of the databricks cluster, to perform decrypt opertations.

Answer 1

Managed identity in Azure Databricks isn't supported yet. But right now you can pass the value of secret as an environment variable, and it will be available in your init script - just specify in cluster configuration:

MY_PASSWORD={{secrets/scope/key}}

and then use in the init script:

if [ -n "$MY_PASSWORD" ]; then
  use password
else
  exit 1
fi