hosted BigQuery instance

Question

Is there any way I can host big query software on my company server? The company does not want the data to be anywhere else other than own data center.

What are BigQuery alternatives? (cloud as well as hosted)

Answer 1

Is there any way I can host big query software on my company server?

Google Big Query is an implementation of the Google Dremel Paper, but is offered as a service and is not available as a software to be installed in-premise.

What are big query alternatives? (cloud as well as hosted)

Apache Drill is an implementation of the above mentioned Dremel, but has just started and might take some time to materialize.

Cloudera has recently announced Imapala for real-time queries on Hadoop. Check the blog for more details.

Would be interested to know some other alternatives for real-time queries on Big Data.

Edit : Here is an interesting article from InfoWorld on the same.

Answer 2

Hive and Pig are two common solutions to making a queryable system, but since you mentioned Google's Big Query, I assume you mean real-time queries.

In addition to the real-time solutions mentioned by Praveen, there are some workarounds to making other column-oriented solutions faster by writing redundant stores, in a normalized fashion. Think of it this way: You can 'pre-join' the data in a column family, as long as you understand that you're trading fast access against excess volume and slower insertion speed.

-t.