apache-spark-sql tutorials

Preserve index-string correspondence spark string indexer

Apr 04, 2016

Extract information from a `org.apache.spark.sql.Row`

Nov 13, 2022

scala apache-spark apache-spark-sql

How to run independent transformations in parallel using PySpark?

Sep 17, 2022

python-2.7 apache-spark pyspark apache-spark-sql python-multiprocessing

How to limit functions.collect_set in Spark SQL?

Aug 20, 2022

apache-spark apache-spark-sql

Why spark application fail with "executor.CoarseGrainedExecutorBackend: Driver Disassociated"?

Oct 31, 2022

apache-spark apache-spark-sql

How to subtract a column of days from a column of dates in Pyspark?

Sep 17, 2022

python apache-spark pyspark apache-spark-sql user-defined-functions

Write DataFrame to mysql table using pySpark

Oct 22, 2020

python mysql apache-spark pyspark apache-spark-sql

What is the maximum size for a broadcast object in Spark?

Sep 16, 2022

apache-spark dataframe apache-spark-sql broadcast

Trying to use map on a Spark DataFrame

Oct 18, 2022

java apache-spark java-8 apache-spark-sql spark-dataframe

what is difference between SparkSession and SparkContext? [duplicate]

Feb 02, 2022

apache-spark apache-spark-sql

Usage of spark DataFrame "as" method

Sep 16, 2022

scala apache-spark dataframe apache-spark-sql

Splitting a row in a PySpark Dataframe into multiple rows

Nov 03, 2021

python apache-spark pyspark apache-spark-sql

What is an optimized way of joining large tables in Spark SQL

Nov 07, 2022

apache-spark apache-spark-sql

Where is the reference for options for writing or reading per format?

Jun 24, 2021

apache-spark apache-spark-sql apache-spark-1.6

Spark - Creating Nested DataFrame

Oct 29, 2020

python apache-spark dataframe pyspark apache-spark-sql

spark sql current timestamp function

Sep 16, 2022

apache-spark apache-spark-sql

Spark 2.0: Relative path in absolute URI (spark-warehouse)

Mar 06, 2021

windows apache-spark pyspark apache-spark-sql pyspark-sql

Convert comma separated string to array in pyspark dataframe

Apr 06, 2022

python apache-spark dataframe pyspark apache-spark-sql

How do I convert a WrappedArray column in spark dataframe to Strings?

Sep 10, 2022

scala apache-spark dataframe apache-spark-sql user-defined-functions

Use collect_list and collect_set in Spark SQL

Sep 16, 2022

apache-spark hive apache-spark-sql

New posts in apache-spark-sql