Is it a good way to run Kafka on Kubernetes?

Question

For a large online application, use k8s to run it. The scale maybe daily activity user 500,000.

The application inside k8s need messaging feature - Pub/Sub, there are these options:

• Kafka
• RabbitMQ
• Redis

Kafka

It needs zookeeper and good to run on os depends on disk I/O. So if install it into k8s cluster, how? The performance will be worse?

And, if keep Kafka outside of the k8s cluster, connect Kafka from application inside the k8s cluster, how about that performance? They are in the different layer, won't be slow?

RabbitMQ

It's slow than Kafka, but for a daily activity user 500,000 application, is it good enough? If so, maybe it's a good choice.

Redis

It's another option. Maybe the most simple one. But from the internet I got that it will lose message sometimes. If true, that's terrible.

---

So, the most important thing is, use Kafka(also with zookeeper) on k8s, good or not in this use case?

Answer 1

For Kafka, you can find some suggestion here. Kubernetes 1.7+ supports local persistent volume, which may be good for Kafka deployment.

Answer 2

Yes, running Kafka on Kubernetes is great. Check out this example: https://github.com/Yolean/kubernetes-kafka. It includes ZooKeeper and Kafka as StatefulSets.

---

PS. Running any of the services in your question on Kubernetes will be pleasant. You can Google the name of the service and "kubernetes" and find example manifests. Many examples here: https://github.com/kubernetes/charts.

Answer 3

You can also take a look to the following project :

https://github.com/EnMasseProject/barnabas

It's about running Kafka on Kubernetes and OpenShift as well. It provides deploying with StatefulSets with persistent volumes or just in memory (for developing or just testing purpose). It provides deploying for Kafka Connect and Prometheus metrics as well.