apache-spark-sql tutorials

Append a new column to an existing parquet file

Oct 17, 2022

apache-spark apache-spark-sql parquet

Why do columns change to nullable in Apache Spark SQL?

Oct 22, 2022

apache-spark apache-spark-sql apache-spark-dataset

Extract words from a string column in spark dataframe

Feb 21, 2022

regex scala apache-spark apache-spark-sql

spark.ml StringIndexer throws 'Unseen label' on fit()

Oct 21, 2022

apache-spark dataframe pyspark apache-spark-sql apache-spark-ml

Filtering rows based on column values in spark dataframe scala

Feb 09, 2022

scala apache-spark dataframe apache-spark-sql

How to calculate Percentile of column in a DataFrame in spark?

Apr 13, 2022

scala apache-spark apache-spark-sql spark-dataframe

How to use a broadcast collection in a udf?

Oct 15, 2022

apache-spark apache-spark-sql

How to group by common element in array?

Nov 18, 2022

apache-spark apache-spark-sql

Spark 2.0: Redefining SparkSession params through GetOrCreate and NOT seeing changes in WebUI

Nov 19, 2022

apache-spark pyspark apache-spark-sql pyspark-sql

What is wrong with spark sql substring function?

Aug 25, 2022

apache-spark-sql spark-dataframe

How to create a custom Transformer from a UDF?

Oct 03, 2022

scala apache-spark apache-spark-sql user-defined-functions apache-spark-ml

Split Spark DataFrame based on condition

Feb 12, 2022

scala apache-spark dataframe apache-spark-sql

How to read ".gz" compressed file using spark DF or DS?

Aug 31, 2022

apache-spark apache-spark-sql gzip apache-spark-dataset

Azure Spark SQL vs U-SQL

Oct 26, 2022

azure apache-spark-sql cortana-intelligence azure-data-lake u-sql

how to add a Incremental column ID for a table in spark SQL

Nov 03, 2022

apache-spark apache-spark-sql spark-dataframe apache-spark-mllib

Count number of duplicate rows in SPARKSQL

Nov 01, 2022

pyspark apache-spark-sql spark-dataframe pyspark-sql

Apache Spark : JDBC connection not working

Nov 16, 2022

postgresql jdbc apache-spark apache-spark-sql

PySpark: Randomize rows in dataframe

Nov 20, 2022

python-3.x apache-spark dataframe pyspark apache-spark-sql

How to do count(*) within a spark dataframe groupBy

Oct 31, 2022

scala apache-spark apache-spark-sql

Spark SQL - How to write DataFrame to text file?

Apr 07, 2022

java apache-spark-sql

New posts in apache-spark-sql