Igor Dvorzhak questions

Igor Dvorzhak answers

• How to pass Spark job properties to DataProcSparkOperator in Airflow?
• How to manage conflicting DataProc Guava, Protobuf, and GRPC dependencies
• Spark UI appears with wrong format (broken CSS)
• Cross account GCS access using Spark on Dataproc
• How can I perform data lineage in GCP? [closed]
• How can I inspect per executor/node memory usage metrics of a pyspark job on Dataproc?
• How to use Google Cloud Storage for checkpoint location in streaming query?
• Spark client mode - YARN allocates a container for driver?
• What are the tools/frameworks that I can use for spark jobs monitoring and alerting?
• import torch not defined on gcp