RuntimeError: Expected a 'cuda' device type for generator but found 'cpu'

Question

I am trying to train PeleeNet pytorch and got the following error

train.py line 80

pelee_voc train configuration

Answer 1

Reading the link provided in @Dwijay 's answer, I found an answer that does not require you to do any source code change. Indeed, it is very dangerous I would say to change PyTorch source code. But the idea of modifying the Generator is the good one. Indeed by default the random number generator generates numbers on CPU, but we want them on GPU.

Therefore, one should actually modify the data loader instantiation to fit the use of the default cuda device. This is highlighted in this GitHub comment:

data_loader = data.DataLoader(
    ...,
    generator=torch.Generator(device='cuda'),
)

This fix worked for me in PyTorch 1.11 (and worked for this other user in PyTorch 1.10).

Answer 2

Turning the shuffle parameter off in the dataloader solved it. Got the answer form here.