Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Sqoop - Binding to YARN queues

So with mapreduce v2 you can use binding to certain YARN queues to manage resources and prioritization. Basically by using

"hadoop jar /xyz.jar -D mapreduce.job.queuename=QUEUE1 /input /output" which works perfectly.

How can integrate Yarn queue binding with Sqoop when you run a sqoop query?

ie. sqoop import \ --connect 'jdbc://server' \ --target-dir \ and what ?

like image 747
user2562618 Avatar asked Apr 13 '15 14:04

user2562618


Video Answer


1 Answers

Use the same method for Sqoop as well i.e

sqoop import -Dmapreduce.job.queuename=NameOfTheQueue\ --connect 'jdbc://server' \ --target-dir \

Note that, the mapreduce.job.queuename parameter should be used after the import but before the connect or other options.

like image 117
cchahadoop Avatar answered Oct 07 '22 01:10

cchahadoop