apache-spark-sql tutorials

Spark SQL - Encoders for Tuple Containing a List or Array as an Element

Apr 10, 2020

PySpark No suitable driver found for jdbc:mysql://dbhost

Mar 12, 2018

apache-spark apache-spark-sql pyspark

Saving Spark DataFrames with nested User Data Types

Oct 27, 2019

apache-spark apache-spark-sql

Performance of loading parquet files into case classes in Spark

Oct 25, 2022

scala apache-spark apache-spark-sql parquet

Why does SparkSQL require two literal escape backslashes in the SQL query?

Nov 10, 2022

apache-spark apache-spark-sql apache-spark-2.0

Outer join two Datasets (not DataFrames) in Spark Structured Streaming

Aug 28, 2022

scala apache-spark apache-spark-sql spark-structured-streaming

Access AWS Glue from local Spark

May 15, 2022

amazon-web-services apache-spark apache-spark-sql aws-glue

Spark SQL performance

Nov 02, 2022

java hbase apache-spark rdd apache-spark-sql

Why do Window functions fail with "Window function X does not take a frame specification"?

Oct 22, 2022

apache-spark pyspark apache-spark-sql window-functions pyspark-sql

PySpark: retrieve mean and the count of values around the mean for groups within a dataframe

May 15, 2019

python sql apache-spark apache-spark-sql window-functions

How to use "cube" only for specific fields on Spark dataframe?

May 05, 2021

scala apache-spark dataframe apache-spark-sql cube

How to split comma separated string and get n values in Spark Scala dataframe?

Oct 25, 2022

scala apache-spark dataframe apache-spark-sql spark-dataframe

PySpark equivalent of function "typedLit" from Scala API

Aug 22, 2022

scala apache-spark pyspark apache-spark-sql

Spark DataFrames with Parquet and Partitioning

Sep 08, 2019

apache-spark apache-spark-sql parquet

Group by and order by in Spark SQL

Oct 14, 2022

apache-spark apache-spark-sql

CodeGen grows beyond 64 KB error when normalizing large PySpark dataframe

Dec 09, 2021

apache-spark pyspark apache-spark-sql pyspark-sql window-functions

Read parquet into spark dataset ignoring missing fields [duplicate]

Dec 14, 2019

apache-spark apache-spark-sql parquet apache-spark-dataset apache-spark-2.0

How to get the number of records written (using DataFrameWriter's save operation)?

Nov 03, 2022

scala apache-spark apache-spark-sql

Connection from Spark to snowflake

Jun 21, 2022

apache-spark apache-spark-sql databricks snowflake-cloud-data-platform

Pyspark: How to convert a spark dataframe to json and save it as json file?

Nov 02, 2022

python-3.x pyspark apache-spark-sql pyspark-sql

New posts in apache-spark-sql