apache-spark-dataset tutorials

Spark Dataset equivalent for scala's "collect" taking a partial function

Feb 22, 2022

scala apache-spark apache-spark-dataset

How to convert Dataset into JavaPairRDD?

Jun 13, 2022

java apache-spark apache-spark-dataset java-pair-rdd

How to create a Dataset from custom class Person?

Jan 23, 2017

apache-spark apache-spark-sql apache-spark-dataset

Array Intersection in Spark SQL

Mar 22, 2022

apache-spark apache-spark-sql spark-dataframe hiveql apache-spark-dataset

How to join two spark dataset to one with java objects?

Sep 05, 2022

java apache-spark apache-spark-dataset apache-spark-encoders

How to transform Dataset<Tuple2<String,DeviceData>> to Iterator<DeviceData>

Feb 16, 2021

java apache-spark apache-spark-2.0 apache-spark-dataset

Apache Spark 2.2: broadcast join not working when you already cache the dataframe which you want to broadcast

Aug 26, 2022

apache-spark apache-spark-sql apache-spark-dataset apache-spark-2.0

Add UUID to spark dataset [duplicate]

Feb 03, 2021

apache-spark apache-spark-dataset spark-csv

how to use spark lag and lead over group by and order by

Nov 15, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark SQL's Scala API - TimestampType - No Encoder found for org.apache.spark.sql.types.TimestampType

Mar 07, 2022

scala apache-spark timestamp apache-spark-sql apache-spark-dataset

Pyspark transform method that's equivalent to the Scala Dataset#transform method

Aug 23, 2022

apache-spark pyspark apache-spark-sql apache-spark-dataset

Spark 2.0 DataSets groupByKey and divide operation and type safety

Aug 17, 2019

scala apache-spark apache-spark-sql apache-spark-dataset

Spark Dataframes- Reducing By Key

Oct 09, 2021

scala apache-spark apache-spark-sql apache-spark-dataset

scala generic encoder for spark case class

Jun 02, 2022

scala apache-spark generics apache-spark-dataset apache-spark-encoders

Kryo Serialization for Spark 2.x Dataset

Oct 30, 2022

kryo apache-spark-dataset apache-spark-2.0

Read parquet into spark dataset ignoring missing fields [duplicate]

Dec 14, 2019

apache-spark apache-spark-sql parquet apache-spark-dataset apache-spark-2.0

How to do non-random Dataset splitting on Apache Spark?

Jun 06, 2022

apache-spark apache-spark-sql apache-spark-dataset apache-spark-2.0

New posts in apache-spark-dataset