Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Parquet file to CSV conversion

I want to convert my Parquet file into CSV . Is there a way for the same as i am only able to find CSV to Parquet file and not vice versa.

like image 538
Avneet Avatar asked Dec 04 '25 18:12

Avneet


1 Answers

This worked for me when using spark 2.1.0. First run spark shell. Something like:

./bin/spark-shell

then:

val sqlContext = new org.apache.spark.sql.SQLContext(sc)
val df = sqlContext.parquetFile("parquet-file.parquet")
df.printSchema()
df.write.format("csv").save("directory")

it will create csv files in directory

like image 78
morpheus Avatar answered Dec 06 '25 10:12

morpheus