Ryan Widmaier questions

Ryan Widmaier answers

• Spark: Removing rows which occur less than N times
• Spark: executor memory exceeds physical limit
• Keeping a unused column in Spark when using group by?
• Achieve concurrency when saving to a partitioned parquet file
• How to reference a dataframe when in an UDF on another dataframe?
• elasticsearch scrolling using python client
• What's the difference between mapping and template in Elasticsearch?
• Spark, Incorrect behaviour when throwing SparkException in EMR
• Why spark executor cores are not equal with active tasks in spark web UI？
• PySpark replace Null with Array