Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Skip blank lines when iterating through file line by line

Tags:

bash

I am iterating through a file line by line and put each word into a array and that works. But it also picks up blank lines and puts it as an item in the array, how can I skip the blank lines?

example file

      Line 1
line 2

line 3
        line 4 

line 5
   line 6

My code

while read line ; do
            myarray[$index]="$line"
            index=$(($index+1))
    done < $inputfile

Possible psuedo code

while read line ; do
           if (line != space);then
            myarray[$index]="$line"
             fi
            index=$(($index+1))
    done < $inputfile
like image 720
MAXGEN Avatar asked Feb 27 '14 21:02

MAXGEN


3 Answers

Be more elegant:

echo "\na\nb\n\nc" | grep -v "^$"

cat $file | grep -v "^$" | next transformations...
like image 114
Bohdan Avatar answered Jan 26 '23 00:01

Bohdan


Implement the same test as in your pseudo-code:

while read line; do
    if [ ! -z "$line" ]; then
        myarray[$index]="$line"
        index=$(($index+1))
    fi
done < $inputfile

The -z test means true if empty. ! negates (i.e. true if not empty).

You can also use expressions like [ "x$line" = x ] or test "x$line" = x to test if the line is empty.

However, any line which contains whitespace will not be considered empty. If that is a problem, you can use sed to remove such lines from the input (including empty lines), before they are passed to the while loop, as in:

sed '/^[ \t]*$/d' $inputfile | while read line; do
    myarray[$index]="$line"
    index=$(($index+1))
done
like image 41
isedev Avatar answered Jan 25 '23 23:01

isedev


Remove the blank lines first with sed.

for word in `sed '/^$/d' $inputfile`; do
    myarray[$index]="$word"
    index=$(($index+1))
done
like image 29
SzG Avatar answered Jan 25 '23 23:01

SzG