Menu
When I run a mapreduce job using hadoop command, I use -libjars to setup my jar to the cache and the classpath. How to do something like this in PIG?
249
Local Mode - To run Pig in local mode, you need access to a single machine; all files are installed and run using your local host and file system. Specify local mode using the -x flag (pig -x local). Tez Local Mode - To run Pig in tez local mode.
Now load the data from the file student_data. txt into Pig by executing the following Pig Latin statement in the Grunt shell. grunt> student = LOAD 'hdfs://localhost:9000/pig_data/student_data.txt' USING PigStorage(',') as ( id:int, firstname:chararray, lastname:chararray, phone:chararray, city:chararray );
There are two ways to add external jars to Pig environment.
Use "-Dpig.additional.jars" to start Pig
pig -Dpig.additional.jars=/local/path/to/your.jar
Use "register" command in Pig scripts or grunt
register /local/path/to/your.jar;
You can use any one according to your requirement.
132
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
