1、安装NVIDIA驱动和CUDA;
2、下载并安装Ollama,使用命令行安装指定安装路径和模型路径:OllamaSetup.exe /DIR="D:\Ollama",安装完成后在ollama设置中修改model路径;
3、Ollama配置国内镜像,在C:à用户--->账户名--->.ollama 路径下新建config.json文件并将下面内容复制保存;
{
"registry": {
"mirrors": {
"registry.ollama.ai": "https://ollama.modelscope.cn"
}
}
}
3、下载LLM qwen3:8b和Embeding Model bge-m3:
ollama pull qwen3:8b
ollama pull bge-m3
4、下载并安装Docker desktop,可使用迅雷从中科大镜像下载,安装时指定安装目录和镜像目录:
".\Docker Desktop Installer.exe" install `
--accept-license `
--installation-dir="D:\Docker " `
--wsl-default-data-root="D:\Docker\WSL"
5、在DockeràsettingàDocker Engine设置国内镜像源,保存并重启Docker:
{
"builder": {
"gc": {
"defaultKeepStorage": "20GB",
"enabled": true
}
},
"experimental": false,
"registry-mirrors": [
"https://docker.m.daocloud.io"
]
}
6、安装git,并clone ragflow:git clone GitHub - infiniflow/ragflow: RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs · GitHub
7、在ragflow/docker路径打开cmd:docker compose -f docker-compose.yml up -d
8、启动后检查:docker compose ps
docker logs -f ragflow-server
9、浏览器访问:http://localhost:80