Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Drawbacks of Spark Streaming in Comparison With Real Streaming Computing Systems

Some say that spark streaming, even though it can handle streams in the form of micro-batches, it is still not quite a streaming computing system like storm. So what are the limiting factors of this micro-batch computing ideology? What makes it less than a real computing system? Thanks!

like image 528
user2895478 Avatar asked Oct 31 '22 16:10

user2895478


1 Answers

Take a look at the Spark Streaming paper here. It compares record-at-a-time and batch streaming. Since it's a paper on Spark, it's more biased towards Spark's approach of batch streaming. Also, the paper is 2 years old and a lot of things happened in that time frame. Here is another ppt to get started.

like image 155
Praveen Sripati Avatar answered Nov 15 '22 10:11

Praveen Sripati