Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in spark-streaming

Can a model be created on Spark batch and use it in Spark streaming?

Spark Streaming from Kafka Consumer

Kafka with Spark 2.1 Structured Streaming - cannot deserialize

NoClassDefFoundError: Could not initialize XXX class after deploying on spark standalone cluster

How to parse JSON data in Scala?

scala spark-streaming

Spark Streaming on a S3 Directory

Is it possible to get the first n elements of every RDD in Spark Streaming?

spark-streaming

Direct Kafka Stream with PySpark (Apache Spark 1.6)

Kafka topic partition and Spark executor mapping

get topic from kafka message in spark

In Spark Streaming, is there a way to detect when a batch has finished?

Streaming data store in hive using spark

java.lang.IllegalArgumentException: Invalid lambda deserialization

How to achieve dynamic load-balancing of tasks in Apache Spark

java.lang.UnsupportedOperationException: 'Writing to a non-empty Cassandra Table is not allowed

Read json from Kafka and write json to other Kafka topic

Increase Kafka Streams Consumer Throughput

Spark Structured Streaming with Hbase integration

Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically

Idiomatic way to use Spark DStream as Source for an Akka stream