apache-spark-2.0 tutorials

Out of Memory Error when Reading large file in Spark 2.1.0

May 25, 2022

spark job keep showing TaskCommitDenied (Driver denied task commit)

Jul 17, 2019

apache-spark pyspark apache-spark-sql pyspark-sql apache-spark-2.0

How to pivot streaming dataset?

Apr 08, 2021

apache-spark spark-structured-streaming apache-spark-2.0

How to cast a WrappedArray[WrappedArray[Float]] to Array[Array[Float]] in spark (scala)

Oct 28, 2021

arrays scala casting spark-dataframe apache-spark-2.0

Spark 2.0 Timestamp Difference in Milliseconds using Scala

Feb 27, 2022

scala timestamp apache-spark-sql user-defined-functions apache-spark-2.0

Livy Server: return a dataframe as JSON?

Jun 04, 2021

json apache-spark cloudera apache-spark-2.0 livy

SparkSession initialization error - Unable to use spark.read

Oct 29, 2022

python apache-spark pyspark apache-spark-sql apache-spark-2.0

Reading Avro messages from Kafka with Spark 2.0.2 (structured streaming)

Nov 04, 2022

scala apache-kafka spark-streaming avro apache-spark-2.0

Spark 2.0.0 Error: PartitioningCollection requires all of its partitionings have the same numPartitions

Apr 26, 2022

join apache-spark apache-spark-sql apache-spark-2.0

Avoid starting HiveThriftServer2 with created context programmatically

Apr 24, 2022

hadoop apache-spark hive apache-spark-sql apache-spark-2.0

Pass system property to spark-submit and read file from classpath or custom path

Feb 28, 2018

java scala apache-spark apache-spark-2.0 spark-submit

How to convert RDD of dense vector into DataFrame in pyspark?

Apr 09, 2022

apache-spark pyspark apache-spark-mllib apache-spark-ml apache-spark-2.0

Apache Spark vs Apache Spark 2 [closed]

Oct 26, 2022

apache-spark apache-spark-2.0

Why does using cache on streaming Datasets fail with "AnalysisException: Queries with streaming sources must be executed with writeStream.start()"?

Nov 04, 2018

scala apache-spark apache-spark-sql apache-spark-2.0 spark-structured-streaming

Spark fails to start in local mode when disconnected [Possible bug in handling IPv6 in Spark??]

Apr 11, 2022

macos shell apache-spark apache-spark-2.0

Timeout Exception in Apache-Spark during program Execution

Jul 22, 2019

scala apache-spark spark-graphx apache-spark-2.0

dynamically bind variable/parameter in Spark SQL?

Sep 18, 2022

scala apache-spark apache-spark-sql apache-spark-2.0

spark off heap memory config and tungsten

Mar 07, 2022

apache-spark apache-spark-sql spark-dataframe apache-spark-2.0 off-heap

New posts in apache-spark-2.0