apache-spark-dataset tutorials

Spark: How can DataFrame be Dataset[Row] if DataFrame's have a schema

Dec 20, 2022

Generic T as Spark Dataset[T] constructor

Dec 16, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

spark collect as Array[T] and not as Array[Row] from data frame

Dec 13, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark Streamming : Reading data from kafka that has multiple schema

Nov 10, 2022

apache-spark apache-kafka spark-streaming apache-spark-dataset

Spark SQL alternatives to groupby/pivot/agg/collect_list using foldLeft & withColumn so as to improve performance

Nov 09, 2022

apache-spark apache-spark-sql apache-spark-dataset

No Java class corresponding to Product with Serializable with Base found

Oct 20, 2022

java scala apache-spark rdd apache-spark-dataset

Spark-SQL Joining two dataframes/ datasets with same column name

Oct 19, 2022

java apache-spark apache-spark-sql apache-spark-dataset

java.lang.UnsupportedOperationException: Error in spark when writing

Oct 19, 2022

apache-spark apache-spark-dataset

Spark using recursive case class

Oct 18, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

using DataSet.repartition in Spark 2 - several tasks handle more than one partition

Nov 01, 2022

apache-spark spark-streaming apache-spark-dataset

Spark Java - Collect multiple columns into array column

Aug 27, 2022

java apache-spark apache-spark-dataset

Spark Datasets - strong typing

Oct 24, 2022

apache-spark dataset apache-spark-dataset

Using stat.bloomFilter in Spark 2.0.0 to filter another dataframe

Dec 06, 2021

scala apache-spark apache-spark-sql apache-spark-dataset bloom-filter

spark convert dataframe to dataset using case class with option fields

Jul 07, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

How to create a Dataset of Maps?

Nov 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

How to create a custom Encoder in Spark 2.X Datasets?

Oct 22, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

How to change case of whole column to lowercase?

Oct 03, 2022

java apache-spark apache-spark-sql apache-spark-dataset

New posts in apache-spark-dataset