Spark UI appears with wrong format (broken CSS)

Question

I am using Apache Spark for the first time. I run my application and when I access localhost:4040 I get what is shown in the picture. I found that maybe setting

spark.ui.enabled true 

could help but I don't know how to do that.

Thanks in advance.

Answer 1

I have faced the same issue while using Spark on Google Cloud Dataproc.

If you will access Spark Job UI not through 4040 port directly, but through YARN Web UI (8088 port) you will see correctly rendered web pages.

To workaround this issue when accessing Spark UI directly through 4040 port you need to reset spark.ui.proxyBase property inside your Spark job (not in CLI/job submission command), because it gets overridden by Spark UI proxy:

sys.props.update("spark.ui.proxyBase", "")

Here is detailed description of this issue.