Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Skip first line of csv while loading in hive table

Hello Friends,

I created table in hive with help of following command -

CREATE TABLE db.test    (       fname STRING,       lname STRING,       age   STRING,       mob   BIGINT    ) row format delimited fields terminated BY '\t' stored AS textfile;  

Now to load data in table from file, I am using following command -

load data local inpath '/home/cluster/TestHive.csv' into table db.test; 

Problem is, all the rows are getting inserted, and I don't want first row because it contains only column names.

Please suggest me a way to skip first line.

Thanks in advance.

like image 877
Pankaj Avatar asked Dec 28 '13 10:12

Pankaj


1 Answers

To get this you can use hive's property which is TBLPROPERTIES ("skip.header.line.count"="1")
you can also refer example -

CREATE TABLE temp    (       name STRING,       id   INT    )  row format delimited fields terminated BY '\t' lines terminated BY '\n'  tblproperties("skip.header.line.count"="1");  
like image 133
Bector Avatar answered Sep 20 '22 06:09

Bector