Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

BigQuery: query cross region

I have a situation like below: I want to run a query against a table of my dataset in EU and to write its result into a table of my dataset in US. Is it possible to do that via the BigQuery REST resource, please ?

In fact, I run my query via a job with location in jobReference = 'EU', BQ can execute sucessfully the query but it cannot write the result into my table of dataset in US. BQ gave me this error

 Not found: Dataset dummy_project:dataset_us was not found in location EU

Do you guys have any idea, please?

Thank you !!!

like image 907
nxh6991 Avatar asked Jun 15 '26 11:06

nxh6991


1 Answers

You can't perform cross region query. You must have your data in the same region to query them.

The solution is to use the BigQuery data transfer to copy a dataset to another one (in the correct region). You haven't no other solution than duplicating all the data in the dataset (no possible to select only a table) to another region (and therefore to pay the data storage and the inter region network traffic)

like image 59
guillaume blaquiere Avatar answered Jun 17 '26 01:06

guillaume blaquiere



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!