Silvio questions

Silvio answers

• Spark SQL Split with Period (.)
• map vs filter in Apache Spark
• Create index for tables within Delta Lake
• change Unix(Epoch) time to local time in pyspark
• Spark read.parquet takes too much time
• Spark-SQL Joining two dataframes/ datasets with same column name
• Databricks dbutils.fs.ls shows files. However, reading them throws an IO error
• python spark alternative to explode for very large data
• Spark structured streaming consistency across sinks
• spark write to disk with N files less than N partitions