How do you install Python libraries on gcloud kubernetes nodes?

Question

I have a gcloud Kubernetes cluster running and a Google bucket that holds some data I want to run on the cluster.

In order to use the data in the bucket, I need gcsfs installed on the nodes. How do I install packages like this on the cluster using gcloud, kubectl, etc.?

Answer 1

Check if a recipe like "Launch development cluster on Google Cloud Platform with Kubernetes and Helm" could help.

Using Helm, you can define workers with additional pip packages:

worker:
  replicas: 8
  limits:
    cpu: 2
    memory: 7500000000
  pipPackages: >-
    git+https://github.com/gcsfs/gcsfs.git
    git+https://github.com/xarray/xarray.git
  condaPackages: >-
    -c conda-forge 
    zarr
    blosc