apache-spark-sql tutorials

Spark: Joining with array

Nov 08, 2022

scala apache-spark apache-spark-sql

how to read json with schema in spark dataframes/spark sql

Oct 15, 2022

scala apache-spark dataframe apache-spark-sql

Spark Dataframe column with last character of other column

Mar 05, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

Count the number of missing values in a dataframe Spark

Oct 31, 2022

dataframe apache-spark pyspark apache-spark-sql

MinMax Normalization in scala

Apr 20, 2022

scala apache-spark normalization apache-spark-sql

Writing RDD partitions to individual parquet files in its own directory

Nov 01, 2022

scala apache-spark apache-spark-sql rdd parquet

Getting the first value from spark.sql.Row

Sep 13, 2022

apache-spark apache-spark-sql

UDF's vs Spark sql vs column expressions performance optimization

Aug 25, 2022

scala apache-spark apache-spark-sql spark-dataframe

Spark structured streaming - update data frame's schema on the fly

Oct 14, 2019

apache-spark apache-spark-sql schema spark-structured-streaming

Setting up a Spark SQL connection with Kerberos

Sep 05, 2022

java apache-spark apache-spark-sql kerberos

Should I persist a Spark dataframe if I keep adding columns in it?

Oct 29, 2022

scala apache-spark dataframe apache-spark-sql persist

Read a bytes column in spark

Oct 25, 2022

apache-spark encoding pyspark apache-spark-sql

Disable spark catalyst optimizer

Sep 27, 2022

apache-spark optimization apache-spark-sql spark-dataframe query-optimization

Databricks SQL - How to get all the rows (more than 1000) in the first run?

Apr 24, 2022

sql apache-spark-sql databricks

mismatched input 'from' expecting <EOF> SQL

Oct 29, 2022

sql apache-spark-sql

When to use Spark DataFrame/Dataset API and when to use plain RDD?

Oct 25, 2022

apache-spark apache-spark-sql spark-dataframe apache-spark-dataset

New posts in apache-spark-sql