Indoordinosaur questions

• How to efficiently remove duplicate rows in Spark Dataframe, keeping row with highest timestamp
• Can compiler optimization elminate a function repeatedly called in a for-loop's conditional?

Indoordinosaur answers