Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Import CSV file from Google Cloud Storage to Google Cloud SQL

I am trying to import a csv file directly into Google Cloud SQL using the command below.

LOAD DATA LOCAL INFILE "gs:/zuds/stg/ems/product_offering_fact/000002_0" INTO TABLE buydoc CHARACTER SET "utf8" FIELDS TERMINATED BY "^";

For some reason, it is returning an error like below. I have confirmed that the file exists. However, notice that the path in the error string has only one '/' Is this a bug or am I missing something obvious?

ERROR 2 (HY000) at line 1: File 'gs:/zuds/stg/ems/product_offering_fact/000002_0' not found (Errcode: 2)

Note:If I use the UI described in the link below, it works. However, the UI does not support non-comma delimited files. https://cloud.google.com/sql/docs/import-export

like image 404
Ibrahim Iskin Avatar asked Sep 14 '25 01:09

Ibrahim Iskin


1 Answers

Cloud SQL doesn't support running LOAD DATA LOCAL INFILE with "gs://" path. From the UI, as the doc suggests, only comma delimited files are supported at this point. Here are two workarounds:

  1. Transform your file to CSV and do an import through UI
  2. Download your gs:// file to your local disk and then run LOAD DATA LOCAL INFILE pointing to the path on your local disk.
like image 174
Tianzhou Avatar answered Sep 15 '25 20:09

Tianzhou