pault

pault has asked 11 questions and find answers to 202 problems.

Stats

About

I'm not a programmer but I write code.

pault questions

Using UDF ignores condition in when
Apply a transformation to multiple columns pyspark dataframe
Read a bytes column in spark
Using a column value as a parameter to a spark DataFrame function
How to set display precision in PySpark Dataframe show
Converting days since epoch to date
TypeError: Column is not iterable - How to iterate over ArrayType()?
How to make good reproducible Apache Spark examples

pault answers

Split string in a spark dataframe column by regular expressions capturing groups
Pyspark converting an array of struct into string
Find minimum value above a certain threshold in a Python list
PySpark - Show a count of column data types in a dataframe
Replace multiple substrings of Pandas Series at once
Returning the highest and lowest correlations from a correlation matrix in pandas
Python: Convert list of dictionaries to list of lists
PySpark Dataframe from Python Dictionary without Pandas
.dropna() increases memory usage
Is there a way to slice dataframe based on index in pyspark?