How to Retain file name when tranferring file in Apache Flume?

Question

I am using Flume 1.3.1 ng, I am transfering a file from spoolDir to HDFS Sink and I need outpufile name same as input file. For example if input file name is sample.gz then output also need as sample.gz

Could you please provide the procedure how can achieve this functionality in Flume 1.3.1 ng.

Answer 1

I am using following settings:

a1.sources.r1.basenameHeader = true
a1.sinks.k1.hdfs.filePrefix = %{basename}

These settings give me following transformation:

original_file.txt -> original_file.1457085474015.txt

And sadly seems you can't remove timestamp from filename :C