Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Update message in Kafka topic

I am using Python Kafka topic.

Is there any provision producer that can update a message in a queue in Kafka and append it to the top of queue again?

According to spec of Kafka, it doesn't seems feasible.

like image 447
Prannoy Mittal Avatar asked Sep 10 '15 17:09

Prannoy Mittal


People also ask

Can we update message in Kafka topic?

According to spec of Kafka, it doesn't seems feasible.

Can Kafka message be modified?

You can modify Kafka topic properties by navigating to the Topics page, and editing content in the Configs tab of the topic Profile.

How do I only use the latest message in Kafka?

If you want to consume only the latest message from kafka topic, Please set “Auto Offset Reset” to “LATEST” and keep other values as default. If you want to consume all the message published from kafka topic Please set “Auto Offset Reset” to “EARLIEST” and keep other values as default.


1 Answers

Kafka is a distributed immutable commit log. That said, there is no possibility to update a message in a topic. Once it is there all you can do is consume it, update and produce to another (or this) topic again

like image 63
serejja Avatar answered Sep 27 '22 23:09

serejja