Interactive admin shell for Apache Kafka

Question

I am experimenting with Kafka. I am able to get a basic cluster with Zookeeper and a broker running and produce/consume data. Is there a interactive administration shell/cli for Kafka? I would like to have one view of all the topics , the partitions of a topic, the produce/consume rates, how much data is persisted, etc. I have searched online and looked in the installation. I couldn't find any administration utility.

Thanks,

Answer 1

There is Kafka Web Console and Kafka Offset Monitor. Kafka Web Console may not have all what you want but in the future it will include what you're asking for.

Answer 2

Kafka metrics might be exposed over JMX and explored in jconsole.

On each broker add following line somewhere in kafka-server-start.sh on Linux/MacOS:

export JMX_PORT=9999

or kafka-server-start.bat on Windows:

set JMX_PORT=9999

Note that most JMX metrics expose the state of local broker, so you'd have to connect to all brokers simultaneously to get the whole picture. So, it's more convenient to export necessary JMX metrics to the monitoring system of your choice (Ganglia/Graphite/Nagios/etc.).