Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Load avro decimal data into BigQuery?

I have AVRO hive-table which has some columns as decimal.I know How Avro store the decimal data that is in Logical-type format.But When i load these data into BigQuery, BigQuery is not able to parse these decimal data it treat them like garbage value.I don't know to load these decimal data into BigQuery.Any help would be appreciated.

like image 294
Vishwanath Sharma Avatar asked Jun 29 '26 22:06

Vishwanath Sharma


1 Answers

With AVRO_DECIMAL type being a relatively recent addition, BigQuery doesn's support it yet. Here's the issuetracker link: https://issuetracker.google.com/issues/65641870

As a temporary workaround you can convert your decimal data to a floating point representation so it can be loaded into BigQuery.

like image 168
Michael Moursalimov Avatar answered Jul 06 '26 04:07

Michael Moursalimov