Chris questions

Chris answers

• Why is Pandas UDF not being parallelized?
• Hadoop YARN: How to force a Node to be Marked "LOST" instead of "SHUTDOWN"?
• What problems can arise from a Spark non-deterministic Pandas UDF
• PySpark: How to evaluate AUC of ML recomendation algorithm?
• How does merge-sort join work in Spark and why can it throw OOM?