csv reading in pig, csv file contains quoted comma

Question

So my data looks something like this

asdf, asdf, "adsf,qwef", asdf 

When i read that data in pig using

PigStorage(',')

It stores the "adsf,qwef" as a two data, and stores it like

{ "adsf } { qwef" } 

I want quotes to be treated as single data.

What should I do?

Im trying to write a pigscript to do this.

Answer 1

You should use the CSVLoader:

data = LOAD 'my.csv' USING org.apache.pig.piggybank.storage.CSVExcelStorage() 
    AS (...);

Where the ... is the identifiers.

NOTE: You'll have to register the Piggybank first. Details here: https://cwiki.apache.org/confluence/display/PIG/PiggyBank