Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Running impala cluster from portable binaries

I'm evaluating multiple big data tools. One of them is of course Impala.
I would like to start Impala cluster by manually starting processes on the cluster nodes. As I'm currently doing for Spark, H2O, Presto and Dask, I would like to grab binaries, copy to nodes, edit configs, and start services on nodes from shell. This works very well, it's straightforward to upgrade and I can easily move to bigger/different clusters when needed. Unfortunately I cannot find resources on proper way for starting required services (Catalog Server, StateStore and daemons) from shell.
I assume it is obvious task but just cannot find a proper example to follow, so my question is how can I start Impala cluster from shell calling Impala binaries?

like image 815
jangorecki Avatar asked Aug 22 '16 20:08

jangorecki


1 Answers

....I would like to start Impala cluster by manually starting processes on the cluster nodes.....how can I start Impala cluster from shell calling Impala binaries?

I guess this is what you are looking for: http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_processes.html#starting_via_cmdline

Update 1:

You may want to pick only the required info from this link: http://doc.mapr.com/plugins/servlet/mobile#content/view/28869628

It has steps to build impala from github, to be run on mapr.

Update 2:

To build Impala, Check these links: https://github.com/cloudera/Impala/wiki/Build-prerequisites https://github.com/cloudera/Impala/wiki/How-to-build-Impala https://cwiki.apache.org/confluence/display/IMPALA/Building+Impala

Update 3:

For expert suggestions on portability please get in touch with:

Impala developers: [email protected]

Taken from http://impala.apache.org/community.html

Time being, you may consider to build the binaries for the readily available linux production environment.

Some more useful links for your situation:

https://cwiki.apache.org/confluence/display/IMPALA/Tips+for+Faster+Impala+Builds https://cwiki.apache.org/confluence/display/IMPALA/Building+native-toolchain+from+scratch+and+using+with+Impala

like image 189
Marco99 Avatar answered Nov 15 '22 01:11

Marco99