Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

How to set the number of partitions for newAPIHadoopFile?

hadoop apache-spark

How to make Spark Streaming (Spark 1.0.0) read the latest data from Kafka (Kafka Broker 0.8.1)

Cannot deploy local Spark job, worker fails with EndPointAssociationError

scala akka apache-spark

How to configure automatic restart of the application driver on Yarn

Derby version mismatch between Spark and Hive : Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

Spark executor lost because of time out even after setting quite long time out value 1000 seconds

apache-spark

Run 3000+ Random Forest Models By Group Using Spark MLlib Scala API

Understanding treeReduce() in Spark

Find name of currently running SparkContext

scala apache-spark

What does the Spark UI light blue part of Tasks progress bar indicate?

collect RDD with buffer in pyspark

apache-spark pyspark

Spark, DataFrame: apply transformer/estimator on groups

Spark SQL package not found

Re-using A Schema from JSON within a Spark DataFrame using Scala

Reading large file in Spark issue - python

python apache-spark

spark executor out of memory in join and reduceByKey

Cannot load main class from JAR file

scala hadoop apache-spark sbt

How to do non-random Dataset splitting on Apache Spark?

How save list to file in spark?

python apache-spark pyspark

PySpark - Add a new nested column or change the value of existing nested columns

apache-spark pyspark