Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to implement change data capture (CDC) using Kafka Connect for Sybase ASE database?

I have a requirement where I have to stream live data base updates into KAFKA topics. So basically, whenever something is added, updated or deleted in the database I want that update to be pushed in kafka topic. I saw some articles on how we can do that for mysql and postgresql using debezium. But the database I want to monitor is Sybase ASE. Does debezium support sybase ASE?

If yes, can someone give me good documentation on it? I could not find any on the internet.

If no, what other way can I implement this change data capture (CDC) functionality for sybase ASE database?

like image 811
Tapan Modi Avatar asked Oct 30 '25 02:10

Tapan Modi


1 Answers

Ideally CDC should be done by reading from the DB log (viz. redo log of Oracle, binlog of MySQL, SSTable of Cassandra, etc.).

For the proprietary DBs, usually the vendor provides an API or tool to read the log. For e.g. Oracle provides Golden Gate. I haven't seen anything similar from Sybase.

One of the possible options with Sybase is JDBC. If you're using Kafka Connect, you can have a look at the JDBC Connector. However, I think it may not be a good solution, if the data volume is significant.

Another alternative could be that the process that writes to the DB also produces a message to the Kafka topic. That is not CDC in true sense, but it can be a workable solution. But you need to handle scenarios where writing to DB is successful but message production to Kafka fails.

like image 135
Saptarshi Basu Avatar answered Nov 01 '25 08:11

Saptarshi Basu



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!