Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to give a custom name to hadoop output files

Tags:

hadoop

I want the output files in the format as 2012117-part-r-00000. Basically I want the output file to have the date appended to it, so that I can arrange the files according to date. I looked at OutputFormat and FileOutputFormat, but it doesn't help my case.

like image 873
RFT Avatar asked Jan 17 '12 20:01

RFT


1 Answers

I just found out for the new API, I can use org.apache.hadoop.mapreduce.lib.output.MultipleOutputs and the method addNamedOutput()

like image 171
RFT Avatar answered Nov 15 '22 16:11

RFT



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!