Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Checking the version of Databricks Runtime in Azure

Is it possible to check the version of Databricks Runtime in Azure?

like image 672
Krzysztof Słowiński Avatar asked Dec 12 '18 10:12

Krzysztof Słowiński


People also ask

What is runtime version in Databricks?

Databricks Runtime ML is a variant of Databricks Runtime that adds multiple popular machine learning libraries, including TensorFlow, Keras, PyTorch, and XGBoost. Photon runtime. Photon is the Azure Databricks native vectorized query engine that runs SQL workloads faster and reduces your total cost per workload.

What is Databricks ml runtime?

Databricks Runtime ML contains many popular machine learning libraries, including TensorFlow, PyTorch, and XGBoost. Databricks Runtime ML includes AutoML, a tool to automatically train machine learning pipelines. Databricks Runtime ML also supports distributed deep learning training using Horovod.


1 Answers

In Scala:

dbutils.notebook.getContext.tags("sparkVersion")

In Python:

spark.conf.get("spark.databricks.clusterUsageTags.sparkVersion")

Is giving you the Databricks runtime and Scala version back, e. g.: 5.0.x-scala2.11 .

like image 127
Hauke Mallow Avatar answered Sep 20 '22 15:09

Hauke Mallow