David Vrba

David Vrba has asked 0 questions and find answers to 24 problems.

Stats

About

I work as a Senior ML Engineer at Socialbakers. Besides that, I am also Apache Spark trainer and consultant. I lecture Spark trainings, workshops and on regular basis, I also give public talks related to Spark and publish articles on Medium.

David Vrba questions

David Vrba answers

Can't write ordered data to parquet in spark
I need to append only those who has non null values in pyspark dataframe
HashAggregate in SparkSQL Query Plan
PySpark: How to extract variables from a struct nested in a struct inside an array?
How to stop Spark resolving UDF column in conditional statement
How to dynamically slice an Array column in Spark?
Spark Window aggregation vs. Group By/Join performance
Error using spark 'save' does not support bucketing right now
Speed up InMemoryFileIndex for Spark SQL job with large number of input files
How to count the trailing zeroes in an array column in a PySpark dataframe without a UDF