I am a data engineer. I am here to upskill myself and help the community with whatever I learn. I am active on -> pandas, python and sometimes on pyspark tags.

Some of my favorite answers (WIP):

PySpark:

1. create a table with spark.catalog.createTable
2. How do I find the most frequent element in a list in pyspark?
3. How to Transpose multiple columns in a Dataframe
4. PySpark - Split Array Column into smaller chunks