spark-streaming-kafka tutorials

pyspark structured streaming write to parquet in batches

Mar 26, 2026

Spark Streaming Kafka Stream batch execution

Jan 02, 2026

java apache-spark apache-kafka spark-streaming spark-streaming-kafka

How to specify the group id of kafka consumer for spark structured streaming?

Jan 02, 2026

apache-spark apache-spark-sql spark-streaming spark-streaming-kafka

Kafka Spark streaming: unable to read messages

Jan 12, 2023

hadoop apache-kafka spark-streaming spark-streaming-kafka

spark streaming + kafka - spark session API

Jan 07, 2023

scala apache-spark apache-kafka spark-streaming-kafka

Provider org.apache.spark.sql.avro.AvroFileFormat could not be instantiated

Dec 14, 2022

apache-spark spark-streaming-kafka spark-avro

Unable to find LoginModule class: org.apache.kafka.common.security.plain.PlainLoginModule

Nov 18, 2022

apache-spark apache-kafka spark-structured-streaming spark-streaming-kafka

Spark 2.4.0 Avro Java - cannot resolve method from_avro

Nov 15, 2022

java scala spark-avro spark-streaming-kafka

Pyspark Failed to find data source: kafka

Sep 05, 2022

apache-spark pyspark apache-kafka spark-streaming-kafka

Increase Kafka Streams Consumer Throughput

Aug 29, 2022

spark-streaming kafka-consumer-api apache-kafka-streams spark-streaming-kafka

Spark structured streaming exactly once - Not achieved - Duplicated events

Mar 02, 2022

apache-spark apache-kafka spark-streaming spark-structured-streaming spark-streaming-kafka

How to define Kafka (data source) dependencies for Spark Streaming?

Apr 15, 2022

apache-spark sbt spark-streaming spark-streaming-kafka

Spark Streaming Kafka stream

Nov 19, 2022

apache-spark apache-kafka spark-streaming spark-streaming-kafka

Spark Structured Streaming with Kafka doesn't honor startingOffset="earliest"

Apr 21, 2022

apache-spark spark-streaming spark-structured-streaming spark-streaming-kafka

Kafka Producer - org.apache.kafka.common.serialization.StringSerializer could not be found

Sep 15, 2022

apache-spark apache-kafka apache-karaf spark-streaming-kafka

Spark streaming + Kafka vs Just Kafka

Feb 06, 2019

apache-spark apache-kafka spark-streaming spark-streaming-kafka

How to write spark streaming DF to Kafka topic

Aug 31, 2022

scala apache-spark apache-kafka spark-streaming spark-streaming-kafka

New posts in spark-streaming-kafka