apache-spark tutorials and guides

PySpark - Adding a Column from a list of values using a UDF

Oct 03, 2019

spark partition data writing by timestamp

Oct 25, 2022

scala apache-spark apache-spark-sql

Invalid Spark URL in local spark session

Jul 26, 2022

apache-spark

UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

Feb 10, 2022

scala unit-testing intellij-idea apache-spark

How can I efficiently read multiple json files into a Dataframe or JavaRDD?

Aug 31, 2018

java json apache-spark

spark error RDD type not found when creating RDD

Jun 12, 2019

scala apache-spark apache-spark-sql

What is the best way to define custom methods on a DataFrame?

May 28, 2021

scala apache-spark apache-spark-sql

java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession

Oct 13, 2022

java apache-spark

Apply same function to all fields of spark dataframe row

Aug 25, 2022

apache-spark apache-spark-sql

Pyspark: Replacing value in a column by searching a dictionary

Nov 03, 2022

python apache-spark dataframe pyspark apache-spark-sql

pyspark and HDFS commands

Sep 05, 2022

python apache-spark hdfs pyspark

Making histogram with Spark DataFrame column

Aug 11, 2022

python pandas apache-spark pyspark apache-spark-sql

Keep only duplicates from a DataFrame regarding some field

Sep 02, 2022

apache-spark pyspark spark-dataframe

how to cast all columns of dataframe to string

Nov 10, 2022

apache-spark pyspark apache-spark-sql

Spark streaming multiple sources, reload dataframe

Nov 17, 2021

postgresql apache-spark spark-streaming apache-spark-sql

Mixed Effects Models in Spark or other technology

Oct 15, 2022

apache-spark regression mixed-models

Spark java Issue creating row with java.util.Map type

Jul 17, 2020

java apache-spark apache-spark-sql

Efficient text preprocessing using PySpark (clean, tokenize, stopwords, stemming, filter)

Apr 18, 2020

python apache-spark pyspark apache-spark-sql text-processing

Election of new zookeeper leader shuts down the Spark Master

Oct 28, 2022

apache-spark apache-zookeeper

NullPointerException thrown in where it can't be thrown

Aug 31, 2022

java lambda nullpointerexception apache-spark

New posts in apache-spark