apache-spark tutorials and guides

Check Type: How to check if something is a RDD or a DataFrame?

Nov 07, 2019

How to fix spark-shell on Windows (fails with "was unexpected at this time")? [closed]

Sep 26, 2022

apache-spark

No module named 'resource' installing Apache Spark on Windows

Oct 16, 2022

python windows apache-spark

how to check if a string column in pyspark dataframe is all numeric

Mar 06, 2022

python apache-spark pyspark apache-spark-sql numeric

Spark: How to save a dataframe with headers?

Aug 31, 2022

java apache-spark

How to convert a table into a Spark Dataframe

Apr 09, 2022

apache-spark pyspark apache-spark-sql spark-dataframe

java.lang.NoClassDefFoundError: org/apache/spark/Logging

Apr 01, 2022

java maven apache-spark cassandra spark-cassandra-connector

TaskSchedulerImpl: Initial job has not accepted any resources;

Dec 29, 2018

java apache-spark cassandra datastax

ERROR yarn.ApplicationMaster: Uncaught exception: java.util.concurrent.TimeoutException: Futures timed out after 100000 milliseconds [duplicate]

Sep 29, 2021

apache-spark akka apache-spark-sql

Count number of words in a spark dataframe

Oct 23, 2022

python apache-spark pyspark apache-spark-sql

Spark 2: how does it work when SparkSession enableHiveSupport() is invoked

Nov 18, 2022

apache-spark hive apache-spark-sql hiveql

Mock a Spark RDD in the unit tests

Mar 18, 2022

scala unit-testing mocking apache-spark scalatest

How to Join Multiple Columns in Spark SQL using Java for filtering in DataFrame

Aug 27, 2022

java apache-spark dataframe apache-spark-sql

spark.sql.crossJoin.enabled for Spark 2.x

Feb 26, 2022

apache-spark google-cloud-dataproc

PySpark: Absolute value of a column. TypeError: a float is required

Mar 01, 2022

python apache-spark pyspark apache-spark-sql

How to redirect entire output of spark-submit to a file

Mar 12, 2022

linux bash apache-spark

Spark SQL performing carthesian join instead of inner join

Mar 09, 2022

scala apache-spark pyspark apache-spark-sql

filter DataFrame with Regex with Spark in Scala

Aug 20, 2021

regex scala apache-spark spark-dataframe

Why agg() in PySpark is only able to summarize one column at a time? [duplicate]

Aug 04, 2020

python apache-spark pyspark apache-spark-sql pyspark-sql

How to export DataFrame to csv in Scala?

Sep 18, 2022

scala csv apache-spark

New posts in apache-spark