Choose 2nd GPU on server

Question

I am running code on server. There are 2 GPUs there, and the 1st one is busy. Yet, I can't find a way to switch between them. I am using pytorch if that is important. Following lines of code should be modified:

device = 'cuda' if torch.cuda.is_available() else 'cpu'

Modification may be stated only here. Thanks.

Answer 1

cuda by defaults chooses cuda:0, switching to the other GPU may be done through cuda:1

So, your line becomes:

device = 'cuda:1' if torch.cuda.is_available() else 'cpu'

You can read more about CUDA semantics.