apache-spark-sql tutorials

Partitioning by multiple columns in Spark SQL

Sep 22, 2022

apache-spark apache-spark-sql window-functions

Spark Dataframe Nested Case When Statement

Nov 12, 2022

sql apache-spark dataframe apache-spark-sql

Check Type: How to check if something is a RDD or a DataFrame?

Nov 07, 2019

python apache-spark dataframe apache-spark-sql rdd

how to check if a string column in pyspark dataframe is all numeric

Mar 06, 2022

python apache-spark pyspark apache-spark-sql numeric

How to convert a table into a Spark Dataframe

Apr 09, 2022

apache-spark pyspark apache-spark-sql spark-dataframe

ERROR yarn.ApplicationMaster: Uncaught exception: java.util.concurrent.TimeoutException: Futures timed out after 100000 milliseconds [duplicate]

Sep 29, 2021

apache-spark akka apache-spark-sql

Count number of words in a spark dataframe

Oct 23, 2022

python apache-spark pyspark apache-spark-sql

Spark 2: how does it work when SparkSession enableHiveSupport() is invoked

Nov 18, 2022

apache-spark hive apache-spark-sql hiveql

How to Join Multiple Columns in Spark SQL using Java for filtering in DataFrame

Aug 27, 2022

java apache-spark dataframe apache-spark-sql

PySpark: Absolute value of a column. TypeError: a float is required

Mar 01, 2022

python apache-spark pyspark apache-spark-sql

Spark SQL performing carthesian join instead of inner join

Mar 09, 2022

scala apache-spark pyspark apache-spark-sql

Why agg() in PySpark is only able to summarize one column at a time? [duplicate]

Aug 04, 2020

python apache-spark pyspark apache-spark-sql pyspark-sql

How to convert rows into a list of dictionaries in pyspark?

Nov 07, 2022

apache-spark pyspark apache-spark-sql

Replacing whitespace in all column names in spark Dataframe

Apr 19, 2022

scala apache-spark apache-spark-sql spark-dataframe

Dropping multiple columns from Spark dataframe by Iterating through the columns from a Scala List of Column names

Nov 20, 2022

scala apache-spark apache-spark-sql

pyspark approxQuantile function

Oct 29, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

ON DUPLICATE KEY UPDATE while inserting from pyspark dataframe to an external database table via JDBC

Mar 16, 2022

apache-spark apache-spark-sql pyspark spark-dataframe pyspark-sql

Is proper event-time sessionization possible with Spark Structured Streaming?

Mar 21, 2022

apache-spark apache-spark-sql spark-structured-streaming

Structured streaming - Metrics in Grafana

Oct 14, 2022

apache-spark apache-spark-sql graphite spark-structured-streaming

Using SparkR JVM to call methods from a Scala jar file

Jan 22, 2021

r scala apache-spark apache-spark-sql sparkr

New posts in apache-spark-sql