apache-spark-sql tutorials

Spark JDBC fetchsize option

Sep 27, 2022

apache-spark jdbc apache-spark-sql

Using pyspark, how do I read multiple JSON documents on a single line in a file into a dataframe?

Apr 21, 2022

apache-spark dataframe pyspark apache-spark-sql

Is my understanding of parallel operations in Spark correct?

Sep 28, 2022

python parallel-processing apache-spark apache-spark-sql

Using a module with udf defined inside freezes pyspark job - explanation?

Mar 12, 2022

pyspark apache-spark-sql user-defined-functions

Is this a bug of spark stream or memory leak?

Nov 01, 2022

memory apache-spark memory-leaks apache-spark-sql

Spark SQL can use FIRST_VALUE and LAST_VALUE in a GROUP BY aggregation (but it's not standard)

Sep 07, 2022

apache-spark-sql

PySpark: TypeError: 'Row' object does not support item assignment

Feb 22, 2018

python pyspark apache-spark-sql

How to More Efficiently Load Parquet Files in Spark (pySpark v1.2.0)

Oct 21, 2022

apache-spark apache-spark-sql pyspark parquet

How to modify a Spark Dataframe with a complex nested structure?

Nov 13, 2022

scala apache-spark apache-spark-sql spark-dataframe

Memory issue with spark structured streaming

Sep 08, 2022

apache-spark apache-spark-sql spark-structured-streaming

How to transform RDD, Dataframe or Dataset straight to a Broadcast variable without collect?

Oct 16, 2022

scala apache-spark dataframe apache-spark-sql

Handling microseconds in Spark Scala

Oct 31, 2022

java scala datetime apache-spark apache-spark-sql

How to validate Spark SQL expression without executing it?

Nov 06, 2022

apache-spark apache-spark-sql

Spark: UDF executed many times

Aug 17, 2022

scala apache-spark apache-spark-sql

Apply function to each row of Spark DataFrame

Mar 14, 2022

apache-spark apache-spark-sql

How to optimize spark sql to run it in parallel

Oct 29, 2022

sql apache-spark parallel-processing apache-spark-sql hadoop-yarn

Why Does Spark Query (Load) from Oracle Is So Slow Comparing to SQOOP?

Nov 09, 2022

oracle apache-spark apache-spark-sql spark-dataframe

Should cache and checkpoint be used together on DataSets? If so, how does this work under the hood?

Sep 15, 2022

apache-spark apache-spark-sql apache-spark-dataset

Spark SQL HiveContext - saveAsTable creates wrong schema

Oct 20, 2022

hive apache-spark apache-spark-sql

Returning Multiple Arrays from User-Defined Aggregate Function (UDAF) in Apache Spark SQL

Aug 26, 2022

java apache-spark apache-spark-sql aggregate-functions user-defined-functions

New posts in apache-spark-sql