apache-spark-2.0 tutorials

Launching Apache Spark SQL jobs from multi-threaded driver

Dec 02, 2022

parse Dataset column of Json to Dataset<Row>

Nov 09, 2022

java json apache-spark apache-spark-2.0

Spark 2.0 Standalone mode Dynamic Resource Allocation Worker Launch Error

Nov 10, 2022

apache-spark jupyter-notebook apache-spark-2.0

Spark step on EMR just hangs as "Running" after done writing to S3

Nov 06, 2022

amazon-web-services apache-spark amazon-s3 pyspark apache-spark-2.0

How to map struct in DataFrame to case class?

Dec 30, 2019

scala apache-spark dataframe apache-spark-sql apache-spark-2.0

How to enable Tungsten optimization in Spark 2?

Oct 25, 2019

apache-spark pyspark apache-spark-sql apache-spark-2.0

Spark 2.0 ALS Recommendation how to recommend to a user

Sep 16, 2022

scala apache-spark machine-learning apache-spark-2.0

How does Spark 2.0 handle column nullability?

Jun 13, 2022

apache-spark pyspark apache-spark-sql apache-spark-2.0

Reading Json file using Apache Spark

Oct 17, 2022

java json hadoop apache-spark apache-spark-2.0

How to transform Dataset<Tuple2<String,DeviceData>> to Iterator<DeviceData>

Feb 16, 2021

java apache-spark apache-spark-2.0 apache-spark-dataset

How to write dataframe with duplicate column name into a csv file in pyspark

Sep 05, 2022

apache-spark pyspark apache-spark-sql apache-spark-2.0

Apache Spark 2.2: broadcast join not working when you already cache the dataframe which you want to broadcast

Aug 26, 2022

apache-spark apache-spark-sql apache-spark-dataset apache-spark-2.0

How to create encoder for custom Java objects?

May 15, 2022

java apache-spark apache-spark-2.0

Workaround for importing spark implicits everywhere

Sep 02, 2020

scala apache-spark spark-dataframe apache-spark-2.0 implicits

pyspark error: 'DataFrame' object has no attribute 'map'

Oct 31, 2022

apache-spark spark-dataframe apache-spark-2.0

Spark2 Can't write dataframe to parquet hive table : HiveFileFormat`. It doesn't match the specified format `ParquetFileFormat`

Feb 06, 2023

apache-spark hive parquet apache-spark-2.0

New posts in apache-spark-2.0