jxc questions

jxc answers

• PySpark UDF optimization challenge using a dictionary with regex's (Scala?)
• Explanation of lambda function inside flatMap function: rdd.flatMap(lambda x: map(lambda e: (x[0], e), x[1]))?
• How to sort only one column within a spark dataframe using pyspark?
• Pyspark converting an array of struct into string
• Convert string list to binary list in pyspark
• How to remove duplicates from a spark data frame while retaining the latest?
• Unify schema across multiple rows of json strings in Spark Dataframe
• How to explode multiple columns, different types and different lengths?
• PySpark replace value in several column at once
• Count occurrences of a list of substrings in a pyspark df column