David Griffin

David Griffin has asked 6 questions and find answers to 63 problems.

Stats

About

I am the Global Practice Lead for Revenue Solutions @ SAP. You can find me at LinkedIn

David Griffin questions

What's the performance impact of converting between `DataFrame`, `RDD` and back?
Why is a Spark Row object so big compared to equivalent structures?
DataFrame-ified zipWithIndex
Cleanest, most efficient syntax to perform DataFrame self-join in Spark
Generate a Spark StructType / Schema from a case class

David Griffin answers

Spark: Sort an RDD by multiple values in a tuple / columns
SparkSQL - accesing nested structures Row( field1, field2=Row(..))
How to check the existence of Kafka topic in Nodejs
get topic from kafka message in spark
In Spark SQL, how do you register and use a generic UDF?
Filter out rows with NaN values for certain column
custom join with non equal keys
Ordering an RDD[String]
How do I ensure that logs are retained forever in Kafka?
How i can integrate Apache Spark with the Play Framework to display predictions in real time?