I can't find pytorch and cudnn version for CUDA 12.4. Which versions can I download and use?

Question

nvidia-smi output says CUDA 12.4 as follows.

I downloaded and installed this as CUDA toolkit

and downloaded cudnn top one:

There is no selection for 12.4. Because of this i downloaded pytorch for CUDA 12.1. I transferred cudnn files to CUDA folder. Bin folder added to path. And results:

I bought a computer to work with CUDA but I can't run it.

Answer 1

I have tried the solution @talonmies suggested (simply uninstall the Cuda toolkit v12.4) and run the command pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 and it worked for me.

I hope this can help you in any way!