apache-spark-sql tutorials

How do I register a function to sqlContext UDF in scala?

Apr 25, 2022

scala apache-spark apache-spark-sql

Creating a SparkSQL UDF in Java outside of SQLContext

Aug 29, 2022

java apache-spark dataframe apache-spark-sql user-defined-functions

Spark DataFrames when udf functions do not accept large enough input variables

Sep 15, 2022

scala apache-spark dataframe apache-spark-sql apache-spark-mllib

How to pass a list of paths to spark.read.load?

Aug 26, 2022

scala apache-spark apache-spark-sql

Multiple WHEN condition implementation in Pyspark

Feb 04, 2022

tsql pyspark apache-spark-sql case-when .when

How HiveContext of spark internally works?

Oct 21, 2022

hadoop apache-spark-sql

Spark SQL performance - JOIN on value BETWEEN min and max

Nov 01, 2021

python apache-spark pyspark apache-spark-sql

Cannot create dataframe from list: pyspark

Sep 18, 2022

python apache-spark pyspark apache-spark-sql

UDF to extract only the file name from path in Spark SQL

Jul 11, 2022

java scala apache-spark apache-spark-sql spark-dataframe

How to find mean of grouped Vector columns in Spark SQL?

Sep 29, 2018

apache-spark apache-spark-sql aggregate-functions user-defined-functions apache-spark-ml

Apache Spark subtract days from timestamp column

May 26, 2020

apache-spark dataframe apache-spark-sql timestamp

How to extract number from string column?

Dec 13, 2019

scala apache-spark apache-spark-sql

filter only not empty arrays dataframe spark [duplicate]

Oct 30, 2022

scala apache-spark apache-spark-sql

Filter out rows with NaN values for certain column

Oct 29, 2022

scala apache-spark apache-spark-sql

Calculate a grouped median in pyspark

Nov 14, 2022

apache-spark pyspark apache-spark-sql

GenericRowWithSchema exception in casting ArrayBuffer to HashSet in DataFrame to RDD from Hive table

Jul 04, 2019

scala apache-spark hive apache-spark-sql apache-spark-1.3

JSON file parsing in Pyspark

Sep 08, 2022

apache-spark dataframe pyspark apache-spark-sql pyspark-sql

How to check if array column is inside another column array in PySpark dataframe

Jun 26, 2022

apache-spark dataframe pyspark apache-spark-sql pyspark-sql

How to concatenate/append multiple Spark dataframes column wise in Pyspark?

Jul 02, 2022

python apache-spark pyspark apache-spark-sql pyspark-sql

How to convert empty arrays to nulls?

Aug 20, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

New posts in apache-spark-sql