I know how to get jobID / ApplicationID from sparkContext. Is there a way to get jobID / ApplicationID from SparkSession?
In sparkContext, we can
sc.applicationId
res0: String = app-20150224184813-11531
The solution is to access SparkContext via SparkSession.
spark.sparkContext.applicationId
res0: String = app-20150224184813-11531
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With