Cody Koeninger questions

Cody Koeninger answers

• Spark + Kafka integration - mapping of Kafka partitions to RDD partitions
• Output Dstream of Apache Spark in Python
• Read Kafka topic in a Spark batch job
• How to save latest offset that Spark consumed to ZK or Kafka and can read back after restart
• Spark Kafka Direct DStream - How many executors and RDD partitions in yarn-cluster mode if num-executors is set?