Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in spark-structured-streaming

Spark structured streaming query always starts with auto.offset.rest=earliest even though auto.offset.reset=latest is set

Spark-Streaming hangs with kafka starting offset at earliest (Kafka 2, spark 2.4.3)

Structured Streaming exception: Append output mode not supported for streaming aggregations

How to use a external trigger to stop structured streaming query?

Kafka Structured Streaming checkpoint

How pass Basic Authentication to Confluent Schema Registry?

How to change the location of _spark_metadata directory?

TypeError: 'Builder' object is not callable Spark structured streaming

Spark 2.3.0 Failed to find data source: kafka

Unable to find LoginModule class: org.apache.kafka.common.security.plain.PlainLoginModule

Spark Structured Streaming with Kafka - How to repartition the data and distribute the processing among worker nodes

Custom state store provider for Apache Spark on Mesos

Spark Structured Streaming program that reads from non-empty Kafka topic (starting from earliest) triggers batches locally, but not on EMR cluster