Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Kafka Connect - Delete Connector with configs?

I know how to delete Kafka connector as mentioned here Kafka Connect - How to delete a connector

But I am not sure if it also delete/erase specific connector related configs, offsets and status from *.sorage.topic for that worker?

For e.g: Lets say I delete a connector having connector-name as"connector-abc-1.0.0" and Kafka connect worker was started with following config.

offset.storage.topic=<topic.name>.internal.offsets
config.storage.topic=<topic.name>.internal.configs
status.storage.topic=<topic.name>.internal.status
  • Now after DELETE call for that connector, will it erased all records from above internal topics for that specific connector?
  • So that I can create new connector with "same name" on same worker but different config(different offset.start or connector.class)?
like image 619
suraj_fale Avatar asked Oct 16 '25 04:10

suraj_fale


1 Answers

When you delete a connector, the offsets are retained in the offsets topic. If you recreate the connector with the same name, it will re-use the offsets from the previous execution (even if the connector was deleted in between).

like image 71
Robin Moffatt Avatar answered Oct 18 '25 21:10

Robin Moffatt