I'm trying to export a BigQuery form UI to Google Storage table but facing this error:
Errors: Table gs://mybucket/delta.csv.gz too large to be exported to a single file. Specify a uri including a to shard export. (error code: invalid)
When trying to export after query I got:
Download Unavailable This result set contains too many rows to download. Please use "Save as Table" and then export the resulting table.
If your data has more than 16,000 rows you'd need to save the result of your query as a BigQuery Table. Afterwards, export the data from the table into Google Cloud Storage using any of the available options (such as the Cloud Console, API, bq or client libraries).
Finally found how to do. we must use "*" in the blob name.
And will create as many file as needed.
It's weird that i can import large file (~GB) but not possible to export large file :(
BigQuery can export up to 1 GB of data per file
For larger than 1GB - BigQuery supports exporting to multiple files
See Single wildcard URI
and Multiple wildcard URIs
in Exporting data into one or more files
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With