apache-spark-dataset tutorials

Apache Spark 2.0: java.lang.UnsupportedOperationException: No Encoder found for java.time.LocalDate

Mar 14, 2022

Encode an ADT / sealed trait hierarchy into Spark DataSet column

Apr 18, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

Why is predicate pushdown not used in typed Dataset API (vs untyped DataFrame API)?

Oct 15, 2022

apache-spark dataframe apache-spark-sql apache-spark-dataset

Mapping Spark DataSet row values into new hash column

Mar 24, 2022

scala apache-spark spark-dataframe apache-spark-dataset

Partition data for efficient joining for Spark dataframe/dataset

Nov 04, 2022

apache-spark apache-spark-sql spark-dataframe partitioning apache-spark-dataset

Spark Dataset select with typedcolumn

Sep 06, 2022

scala apache-spark apache-spark-dataset

Spark simpler value_counts

Sep 21, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark structured streaming - join static dataset with streaming dataset

Sep 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset spark-structured-streaming

How to convert DataFrame to Dataset in Apache Spark in Java?

Oct 24, 2017

java apache-spark spark-dataframe apache-spark-dataset

Why is the error "Unable to find encoder for type stored in a Dataset" when encoding JSON using case classes?

Nov 28, 2021

scala apache-spark apache-spark-dataset apache-spark-encoders

S3 SlowDown error in Spark on EMR

Nov 18, 2022

scala apache-spark amazon-s3 amazon-emr apache-spark-dataset

How to create a Spark Dataset from an RDD

Sep 14, 2022

scala apache-spark dataset apache-spark-dataset

How to name aggregate columns?

Sep 15, 2022

scala apache-spark apache-spark-dataset

How to get keys and values from MapType column in SparkSQL DataFrame

Sep 10, 2022

scala apache-spark dataframe apache-spark-sql apache-spark-dataset

Create DataFrame with null value for few column

Feb 02, 2020

scala apache-spark spark-dataframe apache-spark-dataset

Encoder for Row Type Spark Datasets

Sep 04, 2022

java apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

spark createOrReplaceTempView vs createGlobalTempView

Oct 16, 2022

apache-spark apache-spark-dataset

Spark 2.0 Dataset vs DataFrame

Sep 02, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-2.0

Perform a typed join in Scala with Spark Datasets

Aug 25, 2022

scala apache-spark join apache-spark-sql apache-spark-dataset

DataFrame / Dataset groupBy behaviour/optimization

Nov 04, 2021

performance apache-spark dataframe apache-spark-sql apache-spark-dataset

New posts in apache-spark-dataset