Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Does Bigquery save a timestamp with every row inserted through streaming?

I know that Hbase saves a timestamp with every insert. Is it the same in google BigQuery? How can you access it?

like image 728
Alexandru R Avatar asked May 15 '14 15:05

Alexandru R


People also ask

Does BigQuery support streaming inserts?

Streaming is not available through the free tier. If you attempt to use streaming without enabling billing, you receive the following error: BigQuery: Streaming insert is not allowed in the free tier.

What is the difference between datetime and timestamp in BigQuery?

Datetime type: comprises both calendar date and time. It does not store time zone information: YYYY-MM-DD HH:MM:SS (e.g. ). Timestamp type: comprises date, time, and time zone information.

What is timestamp in BigQuery?

The TIMESTAMP data type is used for values that contain both date and time parts. TIMESTAMP has a range of '1970-01-01 00:00:01' UTC to '2038-01-19 03:14:07' UTC. A DATETIME or TIMESTAMP value can include a trailing fractional seconds part in up to microseconds (6 digits) precision.

Can BigQuery handle streaming data?

You can stream data directly into BigQuery by calling the API in your software. I'll show you an example using the API Explorer, which lets you make an API call from a nice interface in your browser. Before we do that, we need to create a table to stream the data into.


1 Answers

For now the workaround exists:

"This feature is already in the production in a different way. If user want to save a timestamp when a request reaching the BigQuery stream system, user could add a TIMESTAMP column in the table schema, and assign "AUTO" in your json payload. With "AUTO" key words, the system will set the column value to be the wall timestamp on behalf of the user. Hope this helps for your use case."

https://issuetracker.google.com/issues/72080883#comment19

like image 163
One Lazy Raccoon Avatar answered Sep 28 '22 04:09

One Lazy Raccoon