Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Hive join set number of reducers

I need to set number of reducers while doing a join operation in Hive. I don't want to set the same number of reducers to every join job I have. How Can I mention it as an argument? Thanks in advance.

like image 369
Sandeep Avatar asked Feb 13 '12 18:02

Sandeep


1 Answers

At the top of the script file, put this:

set mapred.reduce.tasks=128
like image 70
Donald Miner Avatar answered Sep 24 '22 21:09

Donald Miner