Michael Heil questions

Michael Heil answers

• Delete a specific record in a Kafka topic using compaction
• Consuming kafka batch for multiple partitions
• Read Kafka Topic from beginning
• Can Kafka be used as a distribute work queue
• How to use transactions in Kafka and how to use abortTransaction?
• When does Kafka rotates partition leader? Do we have any property to control it?
• Unable to overwrite default value of "spark.sql.shuffle.partitions" with Spark Structured Streaming
• Kafka Producer guarantees
• Asynchronous auto-commit of offsets fails
• How to write streaming DataFrame into multiple sinks in Spark Structured Streaming