Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Where do you get Google Bigquery usage info (mainly for processed data)

I know that BigQuery offers the first "1 TB of data processed" per month for free but I can't figure out where to look on my dashboard to see my monthly usage. I used to be able to "revert" to the old dashboard which had the info but for the past couple of weeks the "old dashboard" isn't accessible.

like image 663
Erwald Avatar asked Sep 27 '14 22:09

Erwald


People also ask

Where is Google BigQuery data stored?

BigQuery data is stored in columns (leaf attributes). In addition to compressed column values, every column also stores structure information to indicate how the values in a column are distributed throughout the tree using two parameters - definition and repetition levels.

How does BigQuery determine the bytes processed by a query?

When you load data into BigQuery or query the data, you're charged according to the data size. Data size is calculated based on the size of each column's data type. The size of your stored data, and the size of the data processed by your queries is calculated in gigabytes (GB), where 1 GB is 2 30 bytes.


1 Answers

Post GCP Console Redesign Answer

The GCP console was redesigned and now the other answer here no longer applies, but it is still possible to view your usage by going to IAM & Admin -> Quotas.

What you're looking for is "Big Query API: Query usage per day". It doesn't seem possible to view your usage over 30 days unfortunately, but you can see your current usage (per day) and your peak usage over the past 7 days. You can also set a daily quota. If you're just working infrequently or doing a lot in one day, you can set a quota to 1 TiB and prevent yourself from blowing your whole allocation in one day.

You can try sending feedback about these limitations, like I did, by clicking the question mark at the top right and then send feedback.

like image 176
Theo Avatar answered Sep 27 '22 03:09

Theo