Menu
Given that
1. Five machine Kafka cluster
2. 1 topic with 1 partition
3. persisted storage for msgs
4. Each msg of 1 KB
5. 10 producers
Now, Will the max write capability of this cluster BE EQUAL TO max write capability of one java thread onto a disk? If No, what will it be?
873
Why is Kafka fast? Kafka achieves low latency message delivery through Sequential I/O and Zero Copy Principle. The same techniques are commonly used in many other messaging/streaming platforms. Zero copy is a shortcut to save the multiple data copies between application context and kernel context.
You can do this using the load generation tools that ship with Kafka, kafka-producer-perf-test, and kafka-consumer-perf-test. The kafka-*-perf-test tools can be used in several ways. In general, it is expected that these tools be used on a test or development cluster.
How many messages can Apache Kafka® process per second? At Honeycomb, it's easily over one million messages.
if you only have one partiton then kafka cannot scale your topic and use only one machine out of your 5 instance cluster.
cannot tell how well you code your java but results will be similar to kafka I assume with small differences as kafka is optimised for disk writes.
150
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
