PyTorch does not see my available GPU on 21.10

I have CUDA 11.3 installed with Nvidia 510 and evertime I want to run an inference, I get this error:

 torch._C._cuda_init()
RuntimeError: No CUDA GPUs are available

This is my CUDA:

> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Mon_May__3_19:15:13_PDT_2021
Cuda compilation tools, release 11.3, V11.3.109
Build cuda_11.3.r11.3/compiler.29920130_0

When I do nvidia-smi, I get this output:

nvidia-smi
Command 'nvidia-smi' not found, but can be installed with:
sudo apt install nvidia-utils-418-server # version 418.226.00-0ubuntu0.21.10.2, or
sudo apt install nvidia-utils-450-server # version 450.172.01-0ubuntu0.21.10.1
sudo apt install nvidia-utils-470 # version 470.103.01-0ubuntu0.21.10.1
sudo apt install nvidia-utils-470-server # version 470.103.01-0ubuntu0.21.10.1
sudo apt install nvidia-utils-510 # version 510.54-0ubuntu0.21.10.1
sudo apt install nvidia-utils-510-server # version 510.47.03-0ubuntu0.21.10.1
sudo apt install nvidia-utils-390 # version 390.143-0ubuntu2
sudo apt install nvidia-utils-460 # version 460.80-0ubuntu3
sudo apt install nvidia-utils-460-server # version 460.73.01-0ubuntu2
sudo apt install nvidia-utils-465 # version 465.27-0ubuntu3

When I do go ahead and install sudo apt install nvidia-utils-510 and reboot, I get this error:

NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

Output of sudo dpkg -l | grep -i nvidia

ii libaccinj64-11.3:amd64 11.3.111~11.3.1-4 amd64 NVIDIA ACCINJ Library (64-bit)
ii libcublas11:amd64 11.5.1.109~11.3.1-4 amd64 NVIDIA cuBLAS Library
ii libcublaslt11:amd64 11.5.1.109~11.3.1-4 amd64 NVIDIA cuBLASLt Library
ii libcudart11.0:amd64 11.3.109~11.3.1-4 amd64 NVIDIA CUDA Runtime Library
ii libcufft10:amd64 11.1.1+~10.4.2.109~11.3.1-4 amd64 NVIDIA cuFFT Library
ii libcufftw10:amd64 11.1.1+~10.4.2.109~11.3.1-4 amd64 NVIDIA cuFFTW Library
ii libcuinj64-11.3:amd64 11.3.111~11.3.1-4 amd64 NVIDIA CUINJ Library (64-bit)
ii libcupti-dev:amd64 11.3.111~11.3.1-4 amd64 NVIDIA CUDA Profiler Tools Interface development files
ii libcupti-doc 11.3.111~11.3.1-4 all NVIDIA CUDA Profiler Tools Interface documentation
ii libcupti11.3:amd64 11.3.111~11.3.1-4 amd64 NVIDIA CUDA Profiler Tools Interface runtime library
ii libcurand10:amd64 11.1.1+~10.2.4.109~11.3.1-4 amd64 NVIDIA cuRAND Library
ii libcusolver11:amd64 11.1.2.109~11.3.1-4 amd64 NVIDIA cuSOLVER Library
ii libcusolvermg11:amd64 11.1.2.109~11.3.1-4 amd64 NVIDIA cuSOLVERmg Library
ii libcusparse11:amd64 11.6.0.109~11.3.1-4 amd64 NVIDIA cuSPARSE Library
ii libnppc11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives core runtime library
ii libnppial11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Arithmetic and Logic
ii libnppicc11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Color Conversion
ii libnppidei11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Data Exchange and Initialization
ii libnppif11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Filters
ii libnppig11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Geometry transforms
ii libnppim11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Morphological operations
ii libnppist11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Statistics
ii libnppisu11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Support
ii libnppitc11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives lib for Image Threshold and Compare
ii libnpps11:amd64 11.3.3.95~11.3.1-4 amd64 NVIDIA Performance Primitives for signal processing runtime library
ii libnvidia-cfg1-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA binary OpenGL/GLX configuration library
ii libnvidia-common-470 470.103.01-0ubuntu0.21.10.1 all Shared files used by the NVIDIA libraries
rc libnvidia-compute-440:amd64 440.33.01-0ubuntu1 amd64 NVIDIA libcompute package
ii libnvidia-compute-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA libcompute package
ii libnvidia-compute-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVIDIA libcompute package
rc libnvidia-compute-510:amd64 510.54-0ubuntu0.21.10.1 amd64 NVIDIA libcompute package
ii libnvidia-container-tools 1.9.0-1 amd64 NVIDIA container runtime library (command-line tools)
ii libnvidia-container1:amd64 1.9.0-1 amd64 NVIDIA container runtime library
ii libnvidia-decode-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA Video Decoding runtime libraries
ii libnvidia-decode-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVIDIA Video Decoding runtime libraries
ii libnvidia-egl-wayland1:amd64 1:1.1.7-2build1 amd64 Wayland EGL External Platform library -- shared library
ii libnvidia-encode-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVENC Video Encoding runtime library
ii libnvidia-encode-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVENC Video Encoding runtime library
ii libnvidia-extra-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 Extra libraries for the NVIDIA driver
ii libnvidia-fbc1-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA OpenGL-based Framebuffer Capture runtime library
ii libnvidia-fbc1-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVIDIA OpenGL-based Framebuffer Capture runtime library
ii libnvidia-gl-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
ii libnvidia-gl-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
ii libnvidia-ifr1-470:amd64 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA OpenGL-based Inband Frame Readback runtime library
ii libnvidia-ifr1-470:i386 470.103.01-0ubuntu0.21.10.1 i386 NVIDIA OpenGL-based Inband Frame Readback runtime library
ii libnvidia-ml-dev:amd64 11.3.58~11.3.1-4 amd64 NVIDIA Management Library (NVML) development files
ii libnvjpeg11:amd64 11.5.0.109~11.3.1-4 amd64 NVIDIA JPEG library (nvJPEG)
ii libnvrtc-builtins11.3:amd64 11.3.109~11.3.1-4 amd64 CUDA Runtime Compilation (NVIDIA NVRTC Builtins Library)
ii libnvrtc11.2:amd64 11.3.109~11.3.1-4 amd64 CUDA Runtime Compilation (NVIDIA NVRTC Library)
ii libnvtoolsext1:amd64 11.3.109~11.3.1-4 amd64 NVIDIA Tools Extension Library
ii libnvvm4:amd64 11.3.109~11.3.1-4 amd64 NVIDIA NVVM Library
rc linux-modules-nvidia-470-5.13.0-22-generic 5.13.0-22.22+2 amd64 Linux kernel nvidia modules for version 5.13.0-22
rc linux-modules-nvidia-470-5.13.0-23-generic 5.13.0-23.23+1 amd64 Linux kernel nvidia modules for version 5.13.0-23
rc linux-modules-nvidia-470-5.13.0-25-generic 5.13.0-25.26 amd64 Linux kernel nvidia modules for version 5.13.0-25
rc linux-modules-nvidia-470-5.13.0-27-generic 5.13.0-27.29 amd64 Linux kernel nvidia modules for version 5.13.0-27
rc linux-modules-nvidia-470-5.13.0-28-generic 5.13.0-28.31+1 amd64 Linux kernel nvidia modules for version 5.13.0-28
rc linux-modules-nvidia-470-5.13.0-30-generic 5.13.0-30.33 amd64 Linux kernel nvidia modules for version 5.13.0-30
rc linux-modules-nvidia-470-5.13.0-35-generic 5.13.0-35.40 amd64 Linux kernel nvidia modules for version 5.13.0-35
rc linux-modules-nvidia-470-5.13.0-37-generic 5.13.0-37.42 amd64 Linux kernel nvidia modules for version 5.13.0-37
rc linux-modules-nvidia-510-5.13.0-35-generic 5.13.0-35.40 amd64 Linux kernel nvidia modules for version 5.13.0-35
rc linux-modules-nvidia-510-5.13.0-37-generic 5.13.0-37.42 amd64 Linux kernel nvidia modules for version 5.13.0-37
rc linux-objects-nvidia-470-5.13.0-22-generic 5.13.0-22.22+2 amd64 Linux kernel nvidia modules for version 5.13.0-22 (objects)
rc linux-objects-nvidia-470-5.13.0-23-generic 5.13.0-23.23+1 amd64 Linux kernel nvidia modules for version 5.13.0-23 (objects)
rc linux-objects-nvidia-470-5.13.0-25-generic 5.13.0-25.26 amd64 Linux kernel nvidia modules for version 5.13.0-25 (objects)
rc linux-objects-nvidia-470-5.13.0-27-generic 5.13.0-27.29 amd64 Linux kernel nvidia modules for version 5.13.0-27 (objects)
rc linux-objects-nvidia-470-5.13.0-28-generic 5.13.0-28.31+1 amd64 Linux kernel nvidia modules for version 5.13.0-28 (objects)
rc linux-objects-nvidia-470-5.13.0-30-generic 5.13.0-30.33 amd64 Linux kernel nvidia modules for version 5.13.0-30 (objects)
ii linux-objects-nvidia-470-5.13.0-35-generic 5.13.0-35.40 amd64 Linux kernel nvidia modules for version 5.13.0-35 (objects)
ii linux-objects-nvidia-470-5.13.0-37-generic 5.13.0-37.42 amd64 Linux kernel nvidia modules for version 5.13.0-37 (objects)
ii linux-objects-nvidia-510-5.13.0-35-generic 5.13.0-35.40 amd64 Linux kernel nvidia modules for version 5.13.0-35 (objects)
ii linux-objects-nvidia-510-5.13.0-37-generic 5.13.0-37.42 amd64 Linux kernel nvidia modules for version 5.13.0-37 (objects)
ii linux-signatures-nvidia-5.13.0-35-generic 5.13.0-35.40 amd64 Linux kernel signatures for nvidia modules for version 5.13.0-35-generic
ii linux-signatures-nvidia-5.13.0-37-generic 5.13.0-37.42 amd64 Linux kernel signatures for nvidia modules for version 5.13.0-37-generic
ii nvidia-compute-utils-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA compute utilities
rc nvidia-compute-utils-510 510.54-0ubuntu0.21.10.1 amd64 NVIDIA compute utilities
ii nvidia-container-toolkit 1.9.0-1 amd64 NVIDIA container runtime hook
ii nvidia-cuda-dev:amd64 11.3.1-4 amd64 NVIDIA CUDA development files
ii nvidia-cuda-gdb 11.3.109~11.3.1-4 amd64 NVIDIA CUDA Debugger (GDB)
ii nvidia-cuda-toolkit 11.3.1-4 amd64 NVIDIA CUDA development toolkit
ii nvidia-cuda-toolkit-doc 11.3.1-4 all NVIDIA CUDA and OpenCL documentation
ii nvidia-dkms-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA DKMS package
rc nvidia-dkms-510 510.54-0ubuntu0.21.10.1 amd64 NVIDIA DKMS package
ii nvidia-docker2 2.10.0-1 all nvidia-docker CLI wrapper
ii nvidia-driver-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA driver metapackage
ii nvidia-kernel-common-470 470.103.01-0ubuntu0.21.10.1 amd64 Shared files used with the kernel module
rc nvidia-kernel-common-510 510.54-0ubuntu0.21.10.1 amd64 Shared files used with the kernel module
ii nvidia-kernel-source-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA kernel source package
ii nvidia-opencl-dev:amd64 11.3.1-4 amd64 NVIDIA OpenCL development files
ii nvidia-prime 0.8.17.1 all Tools to enable NVIDIA's Prime
ii nvidia-profiler 11.3.111~11.3.1-4 amd64 NVIDIA Profiler for CUDA and OpenCL
ii nvidia-settings 470.57.01-0ubuntu3.1~0.21.10.1 amd64 Tool for configuring the NVIDIA graphics driver
ii nvidia-utils-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA driver support binaries
ii nvidia-visual-profiler 11.3.111~11.3.1-4 amd64 NVIDIA Visual Profiler for CUDA and OpenCL
ii screen-resolution-extra 0.18.1 all Extension for the nvidia-settings control panel
ii xserver-xorg-video-nvidia-470 470.103.01-0ubuntu0.21.10.1 amd64 NVIDIA binary Xorg driver

Where am I going wrong?

Know someone who can answer? Share a link to this question via email, Twitter, or Facebook.