Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Failed job in Cloud Dataflow: enable Dataflow API

I'm currently trying to use Dataflow with Pub/Sub but I'm getting this error:

Workflow failed. Causes: (6e74e8516c0638ca): There was a problem refreshing your credentials. Please check: 1. Dataflow API is enabled for your project. 2. There is a robot service account for your project: service-[project number]@dataflow-service-producer-prod.iam.gserviceaccount.com should have access to your project. If this account does not appear in the permissions tab for yourproject, contact Dataflow support.

I tried to look in the API manager to enable Dataflow API but I can't find Dataflow at all. I'm also not seeing the robot service account.

like image 837
azekirel555 Avatar asked Jan 05 '23 02:01

azekirel555


2 Answers

You can see whether the API is enabled by searching for dataflow within the API Manager (should enumerate whether its enabled or not):

API Manager search for "dataflow"

To find the appropriate robot account, search for dataflow-service-producer-prod.iam.gserviceaccount.com within the IAM page:

IAM search for "dataflow-service-producer-prod.iam.gserviceaccount.com"

Finally, the quick start guide may be of use.

like image 179
Lukasz Cwik Avatar answered Jan 12 '23 23:01

Lukasz Cwik


You can enable it from the console or just use the gcloud command.

Enable Dataflow API: gcloud services enable dataflow.googleapis.com

Disable Dataflow API: gcloud services disable dataflow.googleapis.com

like image 38
Rajesh Hegde Avatar answered Jan 12 '23 22:01

Rajesh Hegde