Is there limitation on number of columns in BigQuery?
I'm thinking to prepare large number of columns as suggested the best practices. https://developers.google.com/bigquery/articles/ingestionbestpractices
The limit is 10,000 columns. This limit was imposed as a somewhat arbitrary one, with the assumption that no one would have more than 10k columns. Looking at the error logs, someone indeed hit this limitation and got an error. There is also a 64k limit on the total size of the row (bytes of CSV data) on import.
2013 update: The row size limit has gone from 64k to 1 MB for CSV and 20 MB for JSON data. It's a good idea to keep the number of columns below 10,000.
Check https://cloud.google.com/bigquery/docs/creating-clustered-tables#limitations
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With