Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Google Cloud Dataproc - Spark and Hadoop Version

In the Google Cloud Dataproc beta what are the versions of Spark and Hadoop?

What version of Scala is Spark compiled for?

like image 701
BAR Avatar asked Feb 08 '23 23:02

BAR


2 Answers

According to the official announcement:

Today, we are launching with clusters that have Spark 1.5 and Hadoop 2.7.1.

like image 137
Emre Sevinç Avatar answered Feb 13 '23 06:02

Emre Sevinç


Current Spark version info is listed in the docs. Spark 2.1.0 uses Scala 2.11.

like image 42
ping George Avatar answered Feb 13 '23 07:02

ping George