apache-spark-dataset tutorials

Spark Dataset: Filter if value is contained in other dataset

Mar 09, 2023

Spark - sortWithInPartitions over sort

Mar 10, 2023

apache-spark apache-spark-sql cassandra spark-cassandra-connector apache-spark-dataset

Sorting numeric String in Spark Dataset

Mar 07, 2023

scala apache-spark apache-spark-dataset

Refresh metadata for Dataframe while reading parquet file

Mar 05, 2023

apache-spark apache-spark-sql parquet apache-spark-dataset

Spark schema from case class with correct nullability

Dec 25, 2022

apache-spark apache-spark-sql apache-spark-ml apache-spark-dataset spark-csv

Using custome UDF withColumn in a Spark Dataset<Row>; java.lang.String cannot be cast to org.apache.spark.sql.Row

Dec 25, 2022

java apache-spark apache-spark-sql user-defined-functions apache-spark-dataset

Spark: How can DataFrame be Dataset[Row] if DataFrame's have a schema

Dec 20, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

Generic T as Spark Dataset[T] constructor

Dec 16, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

spark collect as Array[T] and not as Array[Row] from data frame

Dec 13, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark Streamming : Reading data from kafka that has multiple schema

Nov 10, 2022

apache-spark apache-kafka spark-streaming apache-spark-dataset

Spark SQL alternatives to groupby/pivot/agg/collect_list using foldLeft & withColumn so as to improve performance

Nov 09, 2022

apache-spark apache-spark-sql apache-spark-dataset

No Java class corresponding to Product with Serializable with Base found

Oct 20, 2022

java scala apache-spark rdd apache-spark-dataset

Spark-SQL Joining two dataframes/ datasets with same column name

Oct 19, 2022

java apache-spark apache-spark-sql apache-spark-dataset

java.lang.UnsupportedOperationException: Error in spark when writing

Oct 19, 2022

apache-spark apache-spark-dataset

Spark using recursive case class

Oct 18, 2022

scala apache-spark apache-spark-sql apache-spark-dataset

How to create a custom Encoder in Spark 2.X Datasets?

Oct 22, 2022

scala apache-spark apache-spark-dataset apache-spark-encoders

How to change case of whole column to lowercase?

Oct 03, 2022

java apache-spark apache-spark-sql apache-spark-dataset

New posts in apache-spark-dataset