wsl中ollama不能使用gpu加速

之前还能有gpu加速的, 突然一次发现不能加速了, 启动之后发现只能用cpu了

log

复制代码
time=2024-04-19T00:05:08.213+08:00 level=INFO source=images.go:806 msg="total blobs: 80"
time=2024-04-19T00:05:08.248+08:00 level=INFO source=images.go:813 msg="total unused blobs removed: 43"
time=2024-04-19T00:05:08.249+08:00 level=INFO source=routes.go:1110 msg="Listening on 127.0.0.1:11434 (version 0.1.29)"
time=2024-04-19T00:05:08.250+08:00 level=INFO source=payload_common.go:112 msg="Extracting dynamic libraries to /tmp/ollama3092358058/runners ..."
time=2024-04-19T00:05:15.442+08:00 level=INFO source=payload_common.go:139 msg="Dynamic LLM libraries [cpu_avx rocm_v60000 cuda_v11 cpu_avx2 cpu]"
time=2024-04-19T00:05:15.442+08:00 level=INFO source=gpu.go:77 msg="Detecting GPU type"
time=2024-04-19T00:05:15.442+08:00 level=INFO source=gpu.go:191 msg="Searching for GPU management library libnvidia-ml.so"
time=2024-04-19T00:05:17.729+08:00 level=INFO source=gpu.go:237 msg="Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.535.171.04 /usr/lib/wsl/lib/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_059948e396d205d5/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_268e85175aa9e991/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_36f8a434e9b7b9f2/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_84b2c943d6816eb7/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_abf7e4e84f20581c/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_d1bd230cd08e7436/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_f52c4b8723f8dd33/libnvidia-ml.so.1]"
time=2024-04-19T00:05:17.758+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.535.171.04: nvml vram init failure: 9"
time=2024-04-19T00:05:17.762+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/lib/libnvidia-ml.so.1: nvml vram init failure: 9"
time=2024-04-19T00:05:17.831+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_059948e396d205d5/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:17.881+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_268e85175aa9e991/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:17.931+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_36f8a434e9b7b9f2/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:17.971+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_84b2c943d6816eb7/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:18.038+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_abf7e4e84f20581c/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:18.082+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_d1bd230cd08e7436/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:18.130+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/wsl/drivers/nv_dispi.inf_amd64_f52c4b8723f8dd33/libnvidia-ml.so.1: nvml vram init failure: 3"
time=2024-04-19T00:05:18.130+08:00 level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-04-19T00:05:18.131+08:00 level=INFO source=routes.go:1133 msg="no GPU detected"

导致的原因可能是机器休眠过了, wsl的虚拟机不知道如何重连gpu修改正方法是重启wsl,

复制代码
wsl --shutdown

修复之后的log如下:

复制代码
time=2024-04-19T00:07:52.288+08:00 level=INFO source=images.go:806 msg="total blobs: 37"
time=2024-04-19T00:07:52.297+08:00 level=INFO source=images.go:813 msg="total unused blobs removed: 0"
time=2024-04-19T00:07:52.297+08:00 level=INFO source=routes.go:1110 msg="Listening on 127.0.0.1:11434 (version 0.1.29)"
time=2024-04-19T00:07:52.299+08:00 level=INFO source=payload_common.go:112 msg="Extracting dynamic libraries to /tmp/ollama1882281951/runners ..."
time=2024-04-19T00:07:54.749+08:00 level=INFO source=payload_common.go:139 msg="Dynamic LLM libraries [cpu_avx2 rocm_v60000 cpu_avx cuda_v11 cpu]"
time=2024-04-19T00:07:54.749+08:00 level=INFO source=gpu.go:77 msg="Detecting GPU type"
time=2024-04-19T00:07:54.751+08:00 level=INFO source=gpu.go:191 msg="Searching for GPU management library libnvidia-ml.so"
time=2024-04-19T00:07:56.867+08:00 level=INFO source=gpu.go:237 msg="Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.535.171.04 /usr/lib/wsl/lib/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_059948e396d205d5/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_268e85175aa9e991/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_36f8a434e9b7b9f2/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_84b2c943d6816eb7/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_abf7e4e84f20581c/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_d1bd230cd08e7436/libnvidia-ml.so.1 /usr/lib/wsl/drivers/nv_dispi.inf_amd64_f52c4b8723f8dd33/libnvidia-ml.so.1]"
time=2024-04-19T00:07:56.878+08:00 level=INFO source=gpu.go:249 msg="Unable to load CUDA management library /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.535.171.04: nvml vram init failure: 9"
time=2024-04-19T00:07:56.927+08:00 level=INFO source=gpu.go:82 msg="Nvidia GPU detected"
time=2024-04-19T00:07:56.927+08:00 level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-04-19T00:07:56.941+08:00 level=INFO source=gpu.go:119 msg="CUDA Compute Capability detected: 8.6"
相关推荐
aklry3 分钟前
uniapp三步完成一维码的生成
前端·vue.js
Rubin9311 分钟前
判断元素在可视区域?用于滚动加载,数据埋点等
前端
爱学习的茄子11 分钟前
AI驱动的单词学习应用:从图片识别到语音合成的完整实现
前端·深度学习·react.js
用户38022585982412 分钟前
使用three.js实现3D地球
前端·three.js
程序无bug14 分钟前
Spring 面向切面编程AOP 详细讲解
java·前端
zhanshuo14 分钟前
鸿蒙UI开发全解:JS与Java双引擎实战指南
前端·javascript·harmonyos
撰卢38 分钟前
如何提高网站加载速度速度
前端·javascript·css·html
10年前端老司机43 分钟前
在React项目中如何封装一个可扩展,复用性强的组件
前端·javascript·react.js
Struggler2811 小时前
解决setTimeout/setInterval计时不准确问题的方案
前端
szxinmai主板定制专家1 小时前
【精密测量】基于ARM+FPGA的多路光栅信号采集方案
服务器·arm开发·人工智能·嵌入式硬件·fpga开发