Is it possible to check the version of Databricks Runtime in Azure?
Databricks Runtime ML is a variant of Databricks Runtime that adds multiple popular machine learning libraries, including TensorFlow, Keras, PyTorch, and XGBoost. Photon runtime. Photon is the Azure Databricks native vectorized query engine that runs SQL workloads faster and reduces your total cost per workload.
Databricks Runtime ML contains many popular machine learning libraries, including TensorFlow, PyTorch, and XGBoost. Databricks Runtime ML includes AutoML, a tool to automatically train machine learning pipelines. Databricks Runtime ML also supports distributed deep learning training using Horovod.
In Scala:
dbutils.notebook.getContext.tags("sparkVersion")
In Python:
spark.conf.get("spark.databricks.clusterUsageTags.sparkVersion")
Is giving you the Databricks runtime and Scala version back, e. g.: 5.0.x-scala2.11 .
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With