hadoop delete file which is zero byte

Question

I am looking for a command in hadoop 2.x to delete files which are Zero bytes in hdfs. Can any one please let me know appropriate command. I am trying to find the files that has are of zero bytes in hdfs and delete them from the directory.

Answer 1

for f in $(hdfs dfs -ls -R / | awk '$1 !~ /^d/ && $5 == "0" { print $8 }'); do hdfs dfs -rm "$f"; done

Step by step:

hdfs dfs -ls -R / - list all files in HDFS recursively

awk '$1 !~ /^d/ && $5 == "0" { print $8 }') - print full path of those being not directories and with size 0

for f in $(...); do hdfs dfs -rm "$f"; done - iteratively remove