apache-spark-sql tutorials

Regrouping / Concatenating DataFrame rows in Spark

Nov 18, 2022

Spark-HBASE Error java.lang.IllegalStateException: unread block data

Dec 21, 2021

apache-spark hbase apache-spark-sql

Persisting data to DynamoDB using Apache Spark

Nov 12, 2022

apache-spark amazon-dynamodb apache-spark-sql amazon-emr spark-dataframe

Registering Hive Custom UDF with Spark (Spark SQL) 2.0.0

Aug 23, 2022

apache-spark apache-spark-sql udf

What is the use of queryExecution in spark dataframe?

Sep 07, 2022

apache-spark apache-spark-sql

Apache Spark UDF that returns dynamic data types

Oct 25, 2022

scala apache-spark apache-spark-sql user-defined-functions

How to save bucketed DataFrame?

Jun 13, 2022

apache-spark apache-spark-sql

UDF to map words to term Index in Spark

Mar 14, 2022

apache-spark pyspark apache-spark-sql user-defined-functions apache-spark-ml

how to change column value in spark sql

Sep 05, 2022

sql apache-spark pyspark apache-spark-sql

Kafka with Spark 2.1 Structured Streaming - cannot deserialize

Oct 24, 2022

apache-spark pyspark deserialization apache-spark-sql spark-streaming

How to cache partitioned dataset and use in multiple queries?

Jun 20, 2022

java apache-spark apache-spark-sql

Cumulative distinct count with Spark SQL

Nov 08, 2022

sql apache-spark apache-spark-sql

Why is difference between sqlContext.read.load and sqlContext.read.text?

Sep 15, 2022

apache-spark pyspark apache-spark-sql spark-csv

Error: Could not write class iw because it exceeds JVM code size limits. Method code too large

May 25, 2019

scala apache-spark apache-spark-sql

Scala: How to combine two data frames?

Aug 19, 2022

scala apache-spark apache-spark-sql

How to implement `except` in Apache Spark based on subset of columns?

Sep 15, 2022

scala apache-spark apache-spark-sql

How to cast an array of struct in a spark dataframe using selectExpr?

Mar 12, 2021

sql scala apache-spark dataframe apache-spark-sql

can't resolve ... given input columns

Sep 15, 2021

apache-spark pyspark apache-spark-sql

Spark DataFrame is Untyped vs DataFrame has schema?

Oct 19, 2022

apache-spark apache-spark-sql bigdata

Spark sampling options in JSON reader ignored?

Apr 14, 2022

apache-spark pyspark apache-spark-sql

New posts in apache-spark-sql