Data between quotes and field separator

Question

In the example given below, the last line is not uploaded. I get an error:

Data between close double quote (") and field separator: 

This looks like a bug since all the data between pipe symbol should be treated as a single field.

Schema: one:string,two:string,three:string,four:string

Upload file:

This | is | test only | to check quotes
second | line | "with quotes" | no text
third line | with | "start quote" and | a word after quotes

The first and second line above is processed. But not the third.

---

Update:

Can some please explain why does the following work except the third line?

This | is | test only | to check quotes
second | line | "with quotes" | no text
third line | with | "start quote" and | a word after quotes
forth line | enclosed | {"GPRS","MCC_DETECTED":false,"MNC_DETECTED":false} | how does this work?
fifth line | with | {"start quote"} and | a word after quotes

There can be some fancy explanation to this. From the end user perspective this is absurd.

Answer 1

Using --quote worked perfectly.

bq load 
--source_format CSV --quote "" 
--field_delimiter \t 
--max_bad_records 10 
-E UTF-8   
destination table
Source files 

Answer 2

From the CSV RFC4180 page: "If double-quotes are used to enclose fields, then a double-quote appearing inside a field must be escaped by preceding it with another double quote."

You probably want to do this:

This | is | test only | to check quotes
second | line | "with quotes" | no text
third line | with | " ""start quote"" and " | a word after quotes

More about our CSV input format here.