Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to check version of Spark and Scala in Zeppelin?

When I run interactive spark-shell, I show spark version (2.2.0) and scala version (2.11.8)

Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.2.0
      /_/

Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_131)

However, I want to check which Spark and Scala version I am using with Zeppelin (localhost)

I am not sure that Zeppelin run same spark/scala with my interactive shell.

(I checked https://community.hortonworks.com/questions/54918/how-do-i-tell-which-version-ofspark-i-am-running.html, but that is not I want because I host Zeppelin on localhost)

like image 429
Haha TTpro Avatar asked Nov 09 '17 10:11

Haha TTpro


People also ask

How do I find Scala version?

Check Scala Version Using scala CommandWrite the scala command to your terminal and press enter. After that, it opens Scala interpreter with a welcome message and Scala version and JVM details.

What version of Scala is Spark?

5 is built and distributed to work with Scala 2.12 by default. (Spark can be built to work with other versions of Scala, too.) To write applications in Scala, you will need to use a compatible Scala version (e.g. 2.12. X).

How do I know what version of Zeppelin I have?

The Zeppelin package build number is listed in the build. version file under the notebook deployment directory. By default, the Zeppelin notebook is deployed at { SPARK_DEPLOYMENT_DIR_OF_SIG }/{ NOTEBOOK_NAME }-{ NOTEBOOK_VERSION }/, where SIG specifies the name of the Spark instance group.


1 Answers

for spark version you can run sc.version and for scala run util.Properties.versionString in your zeppelin note

like image 117
Mehrez Avatar answered Oct 05 '22 09:10

Mehrez