Menu
I am new to spark and was trying out a few commands in sparkSql using python when I came across these two commands:
createOrReplaceTempView() and registerTempTable().
What is the difference between the two commands?. They seem to have same set of functionalities.
820
createOrReplaceTempView has been introduced in Spark 2.0 to replace registerTempTable. CreateTempView creates an in-memory reference to the Dataframe in use. The lifetime for this depends on the spark session in which the Dataframe was created in.
createorreplacetempview is used when you desire to store the table for a specific spark session. createorreplacetempview creates (or replaces if that view name already exists) a lazily evaluated "view" that you can then use like a hive table in Spark SQL.
registerTempTable (name)[source] Registers this DataFrame as a temporary table using the given name. The lifetime of this temporary table is tied to the SparkSession that was used to create this DataFrame . New in version 1.3. 0.
def createTempView(viewName: String): Unit Creates a local temporary view using the given name. The lifetime of this temporary view is tied to the SparkSession that was used to create this Dataset def registerTempTable(tableName: String): Unit Registers this Dataset as a temporary table using the given name.
registerTempTable is a part of the 1.x API and has been deprecated in Spark 2.0.
createOrReplaceTempView and createTempView have been introduced in Spark 2.0, as a replacement for registerTempTable.
Other than that registerTempTable and createOrReplaceTempView functionally equivalent and the former one calls the latter one.
91
answered Sep 26 '22 00:09
No difference at all between createOrReplaceTempView and registerTempTable both performs the same functionality and if you open the below link and search for registerTempTable you can see that this function is deprecated in 2.0.
There is a note like below: Deprecated in 2.0 use createOrReplaceTempView instead.
https://spark.apache.org/docs/2.0.0/api/python/pyspark.sql.html
43
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
