apache-spark tutorials and guides

dataframe filter gives NullPointerException

Jul 21, 2022

spark finding max value and the associated key

Apr 07, 2021

python apache-spark tuples max pyspark

Direct Kafka Stream with PySpark (Apache Spark 1.6)

Sep 23, 2022

apache-spark apache-kafka pyspark spark-streaming

Convert Scala expression to Java 1.8

Jun 23, 2022

java scala apache-spark

How to set partition for Window function for PySpark?

Nov 03, 2022

apache-spark pyspark apache-spark-sql google-cloud-dataproc

Kafka topic partition and Spark executor mapping

Nov 13, 2022

java apache-spark apache-kafka spark-streaming kafka-consumer-api

Fetch spark job jar from Nexus

Oct 23, 2022

apache-spark nexus

Date Arithmetic with Multiple Columns in PySpark

Nov 02, 2020

python apache-spark pyspark spark-dataframe

get topic from kafka message in spark

Sep 01, 2022

apache-spark apache-kafka spark-streaming

Can sparklyr be used with spark deployed on yarn-managed hadoop cluster?

Nov 07, 2022

r apache-spark hadoop-yarn sparkapi sparklyr

Transforming PySpark RDD with Scala

Oct 17, 2022

apache-spark pyspark rdd

run spark as java web application

Aug 22, 2022

apache-spark spark-dataframe apache-spark-mllib

Pyspark - how to do case insensitive dataframe joins?

Oct 24, 2022

apache-spark pyspark spark-dataframe

Spark Datasets - strong typing

Oct 24, 2022

apache-spark dataset apache-spark-dataset

Spark Scala - How to group dataframe rows and apply complex function to the groups?

Sep 29, 2022

apache-spark dataframe parallel-processing aggregate-functions custom-function

Why does Spark exit with exitCode: 16?

Mar 03, 2022

apache-spark

In Spark Streaming, is there a way to detect when a batch has finished?

Mar 22, 2022

scala apache-spark spark-streaming cloudera

Is there an effective partitioning method when using reduceByKey in Spark?

Oct 22, 2022

apache-spark rdd partitioning

How to map struct in DataFrame to case class?

Dec 30, 2019

scala apache-spark dataframe apache-spark-sql apache-spark-2.0

run pyspark locally

Jun 17, 2022

python apache-spark pyspark

New posts in apache-spark