How to convert Timestamp to Date format in DataFrame?

Question

I have a DataFrame with Timestamp column, which i need to convert as Date format.

Is there any Spark SQL functions available for this?

Answer 1

You can cast the column to date:

Scala:

import org.apache.spark.sql.types.DateType  val newDF = df.withColumn("dateColumn", df("timestampColumn").cast(DateType)) 

Pyspark:

df = df.withColumn('dateColumn', df['timestampColumn'].cast('date')) 

Answer 2

In SparkSQL:

SELECT   CAST(the_ts AS DATE) AS the_date FROM the_table