mck questions

mck answers

• The difference on reading files in PySpark between reading the whole directory then filtering and reading a part of the directory?
• to_date gives null on format yyyyww (202001 and 202053)
• IllegalArgumentException: A project ID is required for this service but could not be determined from the builder or the environment
• Convert an isodate string into date format in PySpark
• CSV data source does not support null data type in pyspark [duplicate]
• Using Pysparks rdd.parallelize().map() on functions of self-implemented objects/classes
• Is there an idiomatic way to cache Spark dataframes?
• Dealing with Ties in Rank : Pyspark
• Evaluate formulas in Spark DataFrame
• Delete rows in PySpark dataframe based on multiple conditions