BigQuery scheduled query: Cannot create a transfer in > JURISDICTION_US when destination dataset is located in > REGION_ASIA_SOUTHEAST_1

Question

I am getting this error quite frequently while trying to create a scheduled query

Error creating scheduled query: Cannot create a transfer in JURISDICTION_US when destination dataset is located in REGION_ASIA_SOUTHEAST_1

I just need a scheduled query to overwrite data in a table.

Answer 1

I had the same problem while trying to create a scheduled query with python:

400 Cannot create a transfer in REGION_EUROPE_WEST_1 when destination dataset is located in JURISDICTION_EU

I figured out that even my project is located in europe-west1 but my destination dataset was located in multinational location: Europe. I had to update my parent path : parent=project_path to '{project_path}/locations/eu' so that it works.

I hope that it helps someone.

Answer 2

It's look like as a bug from BQ. I got the same problems, with source and destination dataset located in EU both. I've change just for testing purpose the destination for an other EU dataset, and it works. I've finally update the scheduled query to use my first destination choice and now it works.. I can't explain why, but it's seem to be a workaround.

Answer 3

Maybe, you can try with starting from the Scheduled Queries BigQuery UI and click on "+ create schedule query" button, then I don't get error. If I start directly in BigQuery UI I get the same error.