mck questions

mck answers

• Create a new column by replacing comma-separated column's values with a lookup based on another dataframe
• How to order by multiple columns in pyspark
• Error: Missing application resource while running spark-submit
• Spark: How to correctly transform dataframe by mapInPandas
• The difference on reading files in PySpark between reading the whole directory then filtering and reading a part of the directory?
• to_date gives null on format yyyyww (202001 and 202053)
• IllegalArgumentException: A project ID is required for this service but could not be determined from the builder or the environment
• Convert an isodate string into date format in PySpark
• CSV data source does not support null data type in pyspark [duplicate]
• Using Pysparks rdd.parallelize().map() on functions of self-implemented objects/classes