mck questions

mck answers

• convert pyspark dataframe into nested json structure
• Convert array of JSON objects to string in pyspark
• Attach suffixes to PySpark rows
• How to use LIKE operator as a JOIN condition in pyspark as a column
• Best way to use a "python enum" with PySpark inside withColumn("myColumn", myEnum.Giraffe)
• How do I present a single row of a PySpark dataframe vertically in Jupyter notebook output?
• Filtering a column with an empty array in Pyspark
• Pyspark join with mixed conditions
• Get value from Pyspark Column and compare it to a Python dictionary
• scala spark UDF ClassCastException : WrappedArray$ofRef cannot be cast to [Lscala.Tuple2