How to check Spark configuration from command line?

Question

Basically, I want to check a property of Spark's configuration, such as "spark.local.dir" through command line, that is, without writing a program. Is there a method to do this?

Answer 1

There is no option of viewing the spark configuration properties from command line.

Instead you can check it in spark-default.conf file. Another option is to view from webUI.

The application web UI at http://driverIP:4040 lists Spark properties in the “Environment” tab. Only values explicitly specified through spark-defaults.conf, SparkConf, or the command line will appear. For all other configuration properties, you can assume the default value is used.

For more details, you can refer Spark Configuration