Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to give a custom name to hadoop output files

Tags:

hadoop

I want the output files in the format as 2012117-part-r-00000. Basically I want the output file to have the date appended to it, so that I can arrange the files according to date. I looked at OutputFormat and FileOutputFormat, but it doesn't help my case.

like image 873
RFT Avatar asked Jan 17 '12 20:01

RFT


1 Answers

I just found out for the new API, I can use org.apache.hadoop.mapreduce.lib.output.MultipleOutputs and the method addNamedOutput()

like image 171
RFT Avatar answered Nov 15 '22 16:11

RFT