pault

pault has asked 12 questions and find answers to 248 problems.

Stats

About

I'm not a programmer but I write code.

pault questions

Pandas efficiently cut column with bins argument based on another column
Using UDF ignores condition in when
Apply a transformation to multiple columns pyspark dataframe
Read a bytes column in spark
Using a column value as a parameter to a spark DataFrame function
How to set display precision in PySpark Dataframe show
Converting days since epoch to date
TypeError: Column is not iterable - How to iterate over ArrayType()?
How to make good reproducible Apache Spark examples

pault answers

Flattening Maptype column in pyspark
Explode a column with a List of Jsons with Pyspark
Get Top 3 values for every key in a RDD in Spark
User Defined Function in withColumn called just once rather than per DF row
How to convert lists of class objects to a list of their attributes
getting minimum (key, value) in a list that holds a dictionary
Generate empty spark DF provided a list with column names
How does pyspark RDD countByKey() count?
Remove duplicates from PySpark array column
Pyspark SQL query to get rows that are +/- 20% of a specific column