Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark-dataset

Spark Dataset: Filter if value is contained in other dataset

Spark - sortWithInPartitions over sort

Sorting numeric String in Spark Dataset

Refresh metadata for Dataframe while reading parquet file

Spark schema from case class with correct nullability

Using custome UDF withColumn in a Spark Dataset<Row>; java.lang.String cannot be cast to org.apache.spark.sql.Row

Spark: How can DataFrame be Dataset[Row] if DataFrame's have a schema

Generic T as Spark Dataset[T] constructor

spark collect as Array[T] and not as Array[Row] from data frame

Spark Streamming : Reading data from kafka that has multiple schema

Spark SQL alternatives to groupby/pivot/agg/collect_list using foldLeft & withColumn so as to improve performance

No Java class corresponding to Product with Serializable with Base found

Spark-SQL Joining two dataframes/ datasets with same column name

java.lang.UnsupportedOperationException: Error in spark when writing

Spark using recursive case class

How to create a custom Encoder in Spark 2.X Datasets?

How to change case of whole column to lowercase?