jxc questions

jxc answers

• Customised start and end date of the month
• Add new row to pyspark dataframe based on values
• Pyspark RDD aggregate different value fields differently
• How use on Array
• What is the best way to find all occurrences of values from one dataframe in another dataframe?
• PySpark UDF optimization challenge using a dictionary with regex's (Scala?)
• Explanation of lambda function inside flatMap function: rdd.flatMap(lambda x: map(lambda e: (x[0], e), x[1]))?
• How to sort only one column within a spark dataframe using pyspark?
• Pyspark converting an array of struct into string
• Convert string list to binary list in pyspark