Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Native JSON support for BigQuery?

Is there any plan for Google BigQuery to implement native JSON support?

I am considering migrating hive data (~20T) to Google BigQuery, but the table definitions in Hive contains map type which is not supported in BigQuery.

for example, the HiveQL below:

select gid, payload['src'] from data_repository;

although, it can be worked around by using regular expression.

like image 708
Zizon Avatar asked Oct 25 '25 19:10

Zizon


1 Answers

As of 1 Oct 2012, BigQuery supports newline separated JSON for import and export.

Blog post: http://googledevelopers.blogspot.com/2012/10/got-big-json-bigquery-expands-data.html

Documentation on data formats: https://developers.google.com/bigquery/docs/import#dataformats

like image 127
Michael Sheldon Avatar answered Oct 28 '25 08:10

Michael Sheldon



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!