Recommended settings for Kafka Internal Topics after upgrade to 1.0

Question

I am migrating from Kafka 0.10 to the latest 1.0 . I did not set any value for these fields in Kafka 0.10. Can some one let me know what is the recommended settings for a 3 node broker cluster & for a single node broker cluster for the below internal topic settings in server.properties -

• offsets.topic.replication.factor
• transaction.state.log.replication.factor
• transaction.state.log.min.isr

If I am not changing this value after upgrade to 1.0 in a single node kafka broker it will take the default value of 3 . So what will be the behavior in this case?

Answer 1

• For clusters with 3 or more brokers, the default values for these settings are good for most use cases:

  • offsets.topic.replication.factor=3
  • transaction.state.log.replication.factor=3
  • transaction.state.log.min.isr=2

  These default values provide strong availability and durability guarantees as data will be replicated across 3 brokers. They also allow to have 1 broker down and still be able to produce/consume with and without transactions.

• For clusters with a single node you don't have the choice, these settings can't be higher than the number of brokers in the cluster, so they must all be set to 1.