mck questions

mck answers

• How to use LIKE operator as a JOIN condition in pyspark as a column
• Best way to use a "python enum" with PySpark inside withColumn("myColumn", myEnum.Giraffe)
• How do I present a single row of a PySpark dataframe vertically in Jupyter notebook output?
• Filtering a column with an empty array in Pyspark
• Pyspark join with mixed conditions
• Get value from Pyspark Column and compare it to a Python dictionary
• scala spark UDF ClassCastException : WrappedArray$ofRef cannot be cast to [Lscala.Tuple2
• count rows in Dataframe Pyspark
• pyspark equivalent of the flag "isLocal" from Scala API
• Convert pyspark dataframe into list of python dictionaries