How to access Google Cloud Storage bucket using aws-cli

Question

I have an access with both aws and Google Cloud Platform.

Is this possible to do the following,

1. List Google Cloud Storage bucket using aws-cli
2. PUT a CSV file to Google Cloud Storage bucket using aws-cli
3. GET an object(s) from Google Cloud Storage bucket using aws-cli

Answer 1

It is possible. Per GCP documentation

The Cloud Storage XML API is interoperable with ... services such as Amazon Simple Storage Service (Amazon S3)

To do this you need to enable Interoperability in the Settings screen in the Google Cloud Storage console. From there you can creates a storage access key.

Configure the aws cli with those keys. IE aws configure.

You can then use the aws s3 command with the --endpoint-url flag set to https://storage.googleapis.com.

For example:

MacBook-Pro:~$ aws s3 --endpoint-url https://storage.googleapis.com ls
2018-02-09 14:43:42 foo.appspot.com
2018-02-09 14:43:42 bar.appspot.com
2018-05-02 20:03:08 etc.appspot.com

 aws s3 --endpoint-url https://storage.googleapis.com cp test.md s3://foo.appspot.com
 upload: ./test.md to s3://foo.appspot.com/test.md