I see Kafka Connect can write to S3 in Avro or JSON formats. But there is no Parquet support. How hard would this be to add?
Starting with Confluent 5.4.0, there is official support for Parquet output to S3.
The Qubole connector supports writing out parquet - https://github.com/qubole/streamx
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With