Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Reading into SQL Server from Kafka feed [closed]

I need to read from a Kafka feed into a SQL Server database and i'm struggling to find any detail on how to do it. I realise it may be simple, but I've searched and found only stuff about feeding into Kafka from SQL

like image 793
rosscv1 Avatar asked Nov 05 '18 11:11

rosscv1


1 Answers

Use Kafka Connect, and the JDBC Sink connector.

Kafka Connect is part of Apache Kafka, and provides streaming integration between both sources into Kafka, and from Kafka out to targets. To use it you just set up configuration files describing the source and target of data. You can read more about it in this series of blogs:

  • https://www.confluent.io/blog/simplest-useful-kafka-connect-data-pipeline-world-thereabouts-part-1/
  • https://www.confluent.io/blog/blogthe-simplest-useful-kafka-connect-data-pipeline-in-the-world-or-thereabouts-part-2/
  • https://www.confluent.io/blog/simplest-useful-kafka-connect-data-pipeline-world-thereabouts-part-3/

This page includes an example of setting up the JDBC sink.

like image 102
Robin Moffatt Avatar answered Nov 16 '22 04:11

Robin Moffatt