Oli

Oli has asked 0 questions and find answers to 31 problems.

Stats

About

I obtained a PhD in Machine Learning a while ago. It was about online learning, and it was fun! Today I am a data scientist in a French tech company. I have always loved algorithmics in general and parallel computing in particular. I also like soccer and astronomy although that's a bit less relevant to say here (please don't downvote my presentation :-) )

I mostly contribute on posts about Apache Spark, preferably in scala. Love the framework, I use it every day!

Oli questions

Oli answers

append multiple columns to existing dataframe in spark
Does distinct() sort the dataset?
rdd.histogram gives "can not generate buckets with non-number in RDD" error
R - How to replicate rows in a spark dataframe using sparklyr
How to get datediff() in seconds in pyspark?
Spark window partition function taking forever to complete
Why is repartition faster than partitionBy in Spark?
Count particular characters within a column using Spark Dataframe API
In Spark ML, why is fitting a StringIndexer on a column with million of disctinct values yielding an OOM error?
UnsupportedOperationException When Inserting into Map