apache-spark-sql tutorials

SparkSQL sql syntax for nth item in array

Aug 28, 2022

How do I collect a List of Strings from spark DataFrame Column after a GroupBy operation?

Oct 02, 2022

java apache-spark apache-spark-sql

Spark remove duplicate rows from DataFrame [duplicate]

Nov 05, 2022

scala apache-spark dataframe apache-spark-sql

save dataframe as external hive table

Oct 14, 2022

apache-spark hive apache-spark-sql spark-dataframe

Apache Spark - Backend servers

Jun 05, 2022

php apache-spark apache-spark-sql

What is the faster way to count the number of entries in a data frame?

Jun 17, 2022

scala apache-spark apache-spark-sql

Spark Scala Dataframe convert a column of Array of Struct to a column of Map

Nov 11, 2022

scala apache-spark apache-spark-sql

How to create a Dataset of Maps?

Nov 19, 2022

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

How does Spark 2.0 handle column nullability?

Jun 13, 2022

apache-spark pyspark apache-spark-sql apache-spark-2.0

Spark: select with key in map

Apr 19, 2022

apache-spark apache-spark-sql

Set spark configuration

Feb 27, 2022

python-3.x apache-spark pyspark apache-spark-sql

select latest record from spark dataframe

Jun 18, 2022

apache-spark-sql

PySpark explode stringified array of dictionaries into rows

Sep 25, 2022

python apache-spark dataframe pyspark apache-spark-sql

Convert UTC timestamp to local time based on time zone in PySpark

Oct 25, 2022

apache-spark pyspark apache-spark-sql

Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically

Sep 25, 2021

scala apache-spark apache-spark-sql spark-streaming spark-structured-streaming

Spark DataFrame created from JavaRDD<Row> copies all columns data into first column

Sep 13, 2022

apache-spark apache-spark-sql

How is it possible to add new column to existing Dataframe in Spark SQL

May 11, 2022

java-8 dataframe apache-spark-sql spark-dataframe

Broadcast not happening while joining dataframes in Spark 1.6

Oct 20, 2022

scala apache-spark join apache-spark-sql query-optimization

How to drop rows with too many NULL values?

Mar 04, 2022

scala apache-spark dataframe apache-spark-sql

Pyspark : Custom window function

Jun 23, 2022

apache-spark pyspark apache-spark-sql window-functions

New posts in apache-spark-sql