BigQuery to Kafka as a source

Question

I have a streaming data from webpages that is loaded in to BigQuery and I want to connect the BigQuery to Kafka as a source. Is there any connector like kafka-connect that is used for BigQuery sink.

Thanks, Bala

Answer 1

For BigQuery to Kafka, I could not find any direct API. However, you can export data in BigQuery via 1 or Python Client for Google BigQuery . Then, you can use Kafka Python client to import data to Kafka.

For Kafka to BigQuery, Kafka Connect BigQuery Connector and bigquery-kafka-connect are the common sink connectors from Apache Kafka to Google BigQuery.

For more information please check Loading data from Kafka into BigQuery with Kafka Connect.