ubuntu24安装cuda12.6+cudnn9.6

0. 环境检查

终端输入nvidia-smi如果看到如下输出

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.133.07             Driver Version: 570.133.07     CUDA Version: 12.8     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|

说明安装了显卡驱动，并且最高支持cuda12.8。

• 如果输出不正确也可以继续往下看，在1. 安装包下载步骤把NVIDIA-Driver[x]勾选(我没有尝试过，不确定能否成功)

1. 安装包下载

• CUDA官方下载链接
  下载对应的 runfile

2. 安装

• 随后赋予执行权限并运行

sudo chmod +x cuda_12.6.3_560.35.05_linux.run
sudo ./cuda_12.6.3_560.35.05_linux.run

• NOTE: 如果已经安装了显卡驱动, 需要把NVIDIA-Driver[x]取消勾选
• 安装完成后终端出现如下摘要

===========
= Summary =
===========

Driver:   Not Selected
Toolkit:  Installed in /usr/local/cuda-12.6/

Please make sure that
 -   PATH includes /usr/local/cuda-12.6/bin
 -   LD_LIBRARY_PATH includes /usr/local/cuda-12.6/lib64, or, add /usr/local/cuda-12.6/lib64 to /etc/ld.so.conf and run ldconfig as root

To uninstall the CUDA Toolkit, run cuda-uninstaller in /usr/local/cuda-12.6/bin
***WARNING: Incomplete installation! This installation did not install the CUDA Driver. A driver of version at least 560.00 is required for CUDA 12.6 functionality to work.
To install the driver using this installer, run the following command, replacing <CudaInstaller> with the name of this run file:
    sudo <CudaInstaller>.run --silent --driver

Logfile is /var/log/cuda-installer.log

3. 添加环境变量

• 阅读上述摘要可知要添加环境变量
• 打开~/.bashrc在底部添加以下内容

# <<< -- -- -- CUDA Environment -- -- -- >>>
# add front
# export PATH=/usr/local/cuda-12.6/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda-12.6/lib64:$LD_LIBRARY_PATH

# add behind
export PATH=$PATH:/usr/local/cuda-12.6/bin
# export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-12.6/lib64
# <<< -- -- -- CUDA Environment -- -- -- >>>

4. 验证

新开终端执行nvcc -V出现以下内容

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Tue_Oct_29_23:50:19_PDT_2024
Cuda compilation tools, release 12.6, V12.6.85
Build cuda_12.6.r12.6/compiler.35059454_0

• 安装成功

5. CUDNN

CUDNN链接

• 解压tar -xvf cudnn-linux-x86_64-9.6.0.74_cuda12-archive.tar.xz
• 并进入cd cudnn-linux-x86_64-9.6.0.74_cuda12-archive
• 把头文件和库文件移动到cuda对应目录

sudo mv include/cudnn*.h /usr/local/cuda/include
sudo mv lib64/libcudnn* /usr/local/cuda/lib64
sudo chmod a+r /usr/local/cuda/include/cudnn*.h /usr/local/cuda/lib64/libcudnn*

• 验证

cat /usr/local/cuda/include/cudnn*.h | grep CUDNN_MAJOR -A 2