Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Does Google BigQuery support Full-Text search

I'm thinking about copying my text searchable content to Google's BigQuery and then perform full-text search using BigQuery API.

Does Google BigQuery support that scenario?

I could not find "search" command in Google BigQuery API: https://developers.google.com/bigquery/docs/reference/v2/

like image 628
Dennis Gorelik Avatar asked Jun 29 '12 15:06

Dennis Gorelik


People also ask

When should you not use BigQuery?

In addition, cases where datasets are fairly small don't really benefit from BigQuery, with a simple query taking up to a few seconds. As such, it shouldn't be used as a regular OLTP (Online Transaction Processing) database. BigQuery is really meant and suited for BIG data and analytics.

How does Google BigQuery differ from a traditional SQL?

Google BigQuery is a cloud-based Architecture and provides exceptional performance as it can auto-scale up and down based on the data load and performs data analysis efficiently. On the other hand, SQL Server is based on client-server architecture and has fixed performance throughout unless the user scales it manually.


2 Answers

BigQuery support a collection of RegEx and String query functions, making it suitable for text search queries across STRING fields. However, there is a 64k per row (and field) limit for each BigQuery record, so it may not possible to support a totally unstructured, unlimited size, document text search case.

  • https://developers.google.com/bigquery/docs/query-reference#stringfunctions
  • https://developers.google.com/bigquery/docs/query-reference#regularexpressionfunctions

For a full text search capabilities in an App Engine application, I would suggest looking at the new Search API:

  • https://developers.google.com/appengine/docs/python/search/overview
like image 152
Michael Manoochehri Avatar answered Oct 12 '22 13:10

Michael Manoochehri


10 years late and here we are. Today (07/04/22) BigQuery launched It equivalent of Full Text Search. Here is the doc:

https://cloud.google.com/blog/products/data-analytics/pinpoint-unique-elements-with-bigquery-search-features/

like image 25
Murta Avatar answered Oct 12 '22 14:10

Murta