Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Getting broker configuration via kafka-configs.sh

Tags:

apache-kafka

I set up AWS MSK, but it does not have a GUI to view the server configuration. I tried using the kafka-configs.sh, but it didn't output anything useful.

./kafka-configs.sh --bootstrap-server {HOST} --entity-default --entity-type brokers --entity-name 1 --describe

Output: Configs for broker 1 are:

I tried doing this on my local kafka and am getting the same value. What does this mean?

like image 363
Hien Avatar asked Mar 21 '19 21:03

Hien


People also ask

Where is Kafka broker configuration file?

The Kafka configuration files are located at the /opt/bitnami/kafka/config/ directory.

Which is the configuration file for setting up Kafka broker properties?

By using the property file the Kafka makes its configuration. It can be supplied either from a file or programmatically. It is either taken from a default file or else also can be self-programmed.

How do I get broker ID in Kafka?

you can use kafka-manager, an open-source tool powered by yahoo. Show activity on this post. This will list all of the brokers with their id and the beginning offset.


1 Answers

Yes this is a known behavior: https://issues.apache.org/jira/browse/KAFKA-7720

Currently this tool only shows configurations that have been dynamically overridden.

To see all broker configs, you have 2 options:

  • Use the AdminClient.describeConfigs() API
  • Tweak the ConfigCommand.scala tool. Just remove the filter on https://github.com/apache/kafka/blob/ad26914de65e2db244fbe36a2a5fd03de87dfb79/core/src/main/scala/kafka/admin/ConfigCommand.scala#L347

Update: This issue is being addressed by KIP-524 which is currently targetted for Kafka 2.5

like image 187
Mickael Maison Avatar answered Dec 23 '22 00:12

Mickael Maison