List buckets that match a bucket label with gsutil

Question

I have my google cloud storage buckets labeled

I can't find anything in the docs on how to do a gsutil ls but only filter buckets with a specific label- is this possible?

Answer 1

Just had a use case where I wanted to list all buckets with a specific label. The accepted answer using subprocess was noticeably slow for me. Here is my solution using the Python client library for Cloud Storage:

from google.cloud import storage


def list_buckets_by_label(label_key, label_value):
    # List out buckets in your default project
    client = storage.Client()
    buckets = client.list_buckets() # Iterator

    # Only return buckets where the label key/value match inputs
    output = list()
    for bucket in buckets:
        if bucket.labels.get(label_key) == label_value:
            output.append(bucket.name)
    return output

Answer 2

Nowadays is not possible to do what you want in one single step. You can do it in 3 steps:

1. getting all the buckets of your GCP project.
2. Get the labels of every bucket.
3. Do the gsutil ls of every bucket that accomplish your criteria.

This is my python 3 code that I did for you.

import subprocess
out = subprocess.getoutput("gsutil ls")


for line in out.split('\n'):
    label = subprocess.getoutput("gsutil label get "+line)
    if "YOUR_LABEL" in str(label):
        gsout = subprocess.getoutput("gsutil ls "+line)
        print("Files in "+line+":\n")
        print(gsout)