The Dataproc clusters I created always show status as "running" on web portal. Is there a way to stop/deprovision a cluster when it is not in use so that it does not burn resources and $$?
We recently launched the ability to stop and start clusters.
https://cloud.google.com/dataproc/docs/guides/dataproc-start-stop
As described in the Dataprod documentation you can delete a running Dataproc cluster either by choosing the "Delete" option from the Dataproc dashboard, by running the Cloud SDK command gcloud dataproc clusters delete cluster-name
or by calling the clusters.delete REST method.
You can achieve the AZURE "STOP" functionality described by you in GCP as well. However, its just not click of the button, whereas you need to go to Compute engine and stop all the Vm's associated with your cluster. You will be only charged for the disk space used by the cluster
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With