apache-spark-sql tutorials

How to create a z-score in Spark SQL for each group

Aug 29, 2022

convert dataframe to libsvm format

Sep 27, 2022

apache-spark pyspark apache-spark-sql spark-dataframe apache-spark-mllib

Why dataset.count() is faster than rdd.count()?

Apr 14, 2022

scala performance apache-spark apache-spark-sql apache-spark-dataset

merge multiple small files in to few larger files in Spark

Aug 29, 2022

scala hadoop apache-spark hive apache-spark-sql

Elegant Json flatten in Spark [duplicate]

Jul 01, 2020

json scala apache-spark apache-spark-sql

Custom aggregation on PySpark dataframes [duplicate]

Jun 03, 2020

apache-spark pyspark apache-spark-sql aggregate-functions user-defined-functions

org.apache.spark.sql.AnalysisException: cannot resolve given input columns

Jan 03, 2022

scala apache-spark dataframe apache-spark-sql spark-jobserver

Spark Mongodb Connector Scala - Missing database name

Aug 09, 2019

mongodb scala apache-spark apache-spark-sql

Check if table exists in hive metastore using Pyspark

Nov 18, 2022

python-3.x apache-spark hive pyspark apache-spark-sql

Select array element from Spark Dataframes split method in same call?

Feb 03, 2022

python apache-spark pyspark apache-spark-sql

Convert List into dataframe spark scala

Nov 16, 2022

scala apache-spark apache-spark-sql spark-dataframe

How to read simple text file from Google Cloud Storage using Spark-Scala local Program

Oct 23, 2022

scala google-app-engine apache-spark-sql google-cloud-storage google-cloud-dataproc

Get IDs for duplicate rows (considering all other columns) in Apache Spark

Nov 06, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

How to force inferSchema for CSV to consider integers as dates (with "dateFormat" option)?

Mar 06, 2021

apache-spark dataframe apache-spark-sql spark-csv

Pyspark : select specific column with its position

Feb 15, 2021

pyspark apache-spark-sql

Apache zeppelin tutorial, error "sql interpreter not found"

Apr 06, 2022

apache-spark-sql apache-zeppelin

pyspark : Convert DataFrame to RDD[string]

Aug 30, 2022

python apache-spark dataframe pyspark apache-spark-sql

Spark - Divide int with column?

Dec 13, 2021

java apache-spark dataframe apache-spark-sql

Date and Interval Addition in SparkSQL

Nov 09, 2022

sql apache-spark apache-spark-sql

find the closest time between two tables in spark

Apr 24, 2022

sql apache-spark pyspark apache-spark-sql

New posts in apache-spark-sql