Usable space exhausted in flume using file channel

Question

I’m working on Flume with Spool Directory as the Source,HDFS as sink and File as channel. When executing the flume job. I’m getting below issue. Memory channel is working fine. But we need to implement the same using File channel. Using file channel I’m getting below issue.

I have configured the JVM memory size to 3GB in flume.env.sh file. Please let me know any other settings we need to do.

20 Jan 2016 20:05:27,099 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner$PollingRunner.run:160) - Unable to deliver event. Exception follows. java.lang.IllegalStateException: Channel closed [channel=Artiva-memory-channel]. Due to java.io.IOException: Usable space exhausted, only 427515904 bytes remaining, required 524288000 bytes

Answer 1

File channel has nothing to do with memory but with HDD (disk). Such a channel uses the file system for storing the data. Thus, check how much free space is available in the disks where the checkpoint file and data files are written (please, have a look on the FileChannel parameters).