Delta Lake creates a checkpoint automatically per 10 version. Is there any way to create checkpoint manually?
Step 2: To Get the Absolute path of the Delta Table. To know the default location data path, we use the desc formatted table_name hive SQL command. This provides the meta information of the table like column types, table type, data location, etc.
To find the size of a delta table, you can use a Apache Spark SQL command.
You can restore a Delta table to its earlier state by using the RESTORE command. A Delta table internally maintains historic versions of the table that enable it to be restored to an earlier state.
import org.apache.spark.sql.delta.DeltaLog
DeltaLog.forTable(spark,dataPath).checkpoint()
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With