Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to checkpoint a delta table manually?

Tags:

delta-lake

Delta Lake creates a checkpoint automatically per 10 version. Is there any way to create checkpoint manually?

like image 231
dukyz Avatar asked Nov 09 '19 06:11

dukyz


People also ask

How do I find the path of a Delta table?

Step 2: To Get the Absolute path of the Delta Table. To know the default location data path, we use the desc formatted table_name hive SQL command. This provides the meta information of the table like column types, table type, data location, etc.

How do you measure a Delta table?

To find the size of a delta table, you can use a Apache Spark SQL command.

How do I restore my Delta table?

You can restore a Delta table to its earlier state by using the RESTORE command. A Delta table internally maintains historic versions of the table that enable it to be restored to an earlier state.


1 Answers

import org.apache.spark.sql.delta.DeltaLog 
DeltaLog.forTable(spark,dataPath).checkpoint()
like image 143
dukyz Avatar answered Oct 07 '22 20:10

dukyz