windows搭建agent环境

1. 安装python环境

首先安装一个uv，用来管理虚拟环境

shell 复制代码

pip install uv

Python 版本管理

安装和管理 Python 解释器本身。

uv python install: 安装 Python 版本
uv python list: 查看可用 Python 版本
uv python find: 查找已安装的 Python 版本
uv python pin: 将当前项目固定使用特定 Python 版本
uv python uninstall: 卸载 Python 版本

查看有哪些可用的版本

shell 复制代码

uv python list

如果有安装则有具体的路径

shell 复制代码

cpython-3.15.0a2-windows-x86_64-none                 <download available>
cpython-3.15.0a2+freethreaded-windows-x86_64-none    <download available>
cpython-3.14.0-windows-x86_64-none                   <download available>
cpython-3.14.0+freethreaded-windows-x86_64-none      <download available>
cpython-3.13.9-windows-x86_64-none                   <download available>
cpython-3.13.9+freethreaded-windows-x86_64-none      <download available>
cpython-3.12.12-windows-x86_64-none                  <download available>
cpython-3.11.14-windows-x86_64-none                  <download available>
cpython-3.10.19-windows-x86_64-none                  <download available>
cpython-3.10.2-windows-x86_64-none                   AppData\Local\Programs\Python\Python310\python.exe
cpython-3.9.25-windows-x86_64-none                   <download available>
cpython-3.8.20-windows-x86_64-none                   <download available>
pypy-3.11.13-windows-x86_64-none                     <download available>
pypy-3.10.16-windows-x86_64-none                     <download available>
pypy-3.9.19-windows-x86_64-none                      <download available>
pypy-3.8.16-windows-x86_64-none                      <download available>
graalpy-3.12.0-windows-x86_64-none                   <download available>
graalpy-3.11.0-windows-x86_64-none                   <download available>
graalpy-3.10.0-windows-x86_64-none                   <download available>

安装一个3.12版本

shell 复制代码

uv python install 3.12.12

创建虚拟环境

shell 复制代码

mkdir agent && cd agent
uv venv --python 3.12.12

复制代码

Using CPython 3.12.12
Creating virtual environment at: .venv
Activate with: .venv\Scripts\activate

激活环境

powershell环境

shell 复制代码

# pwoershell环境临时放开权限
Set-ExecutionPolicy RemoteSigned -Scope CurrentUser 
.venv\Scripts\activate.ps1

cmd环境

shell 复制代码

.venv\Scripts\activate.bat

复制代码

(agent) D:\agent>

安装依赖

shell 复制代码

uv pip install openai

2. 下载模型

不会魔法，只能镜像，有啥用啥

2.1 hf镜像

安装依赖

shell 复制代码

uv pip install -U huggingface_hub

修改镜像依赖

shell 复制代码

export HF_ENDPOINT=https://hf-mirror.com # linux
$env:HF_ENDPOINT = "https://hf-mirror.com" # powershell

最后还是没有下载成功，哈哈哈哈，我他妈疯了

shell 复制代码

huggingface-cli download Qwen/Qwen3-0.6B

手动下载

一个一个点过去

脚本下载

shell 复制代码

#!/usr/bin/env python3
# -*- coding: utf-8 -*-

import os
os.environ["HF_ENDPOINT"] = "https://hf-mirror.com"  # 设置为hf的国内镜像网站

from huggingface_hub import snapshot_download

model_name = "Qwen/Qwen3-0.6B"
# while True 是为了防止断联
while True:
    try:
        snapshot_download(
            repo_id=model_name,
            local_dir_use_symlinks=True,  # 在local-dir指定的目录中都是一些"链接文件"
            local_dir=model_name,
            resume_download=True
        )
        break
    except:
        pass

2.2 modelscope镜像

https://www.modelscope.cn/models

安装依赖

shell 复制代码

uv pip install modelscope

下载模型

shell 复制代码

modelscope download --model Qwen/Qwen3-0.6B

哈哈，下载成功了

3. 搭建LLM服务

3.1 依赖下载

Cmake

https://cmake.org/files/

git-for-windows

https://registry.npmmirror.com/binary.html?path=git-for-windows/

https://mirrors.huaweicloud.com/git-for-windows/

https://git-scm.com/install/windows

GCC

cygwin或者mingw二选一即可

cygwin

https://files.1f0.de/mingw/

mingw

https://github.com/skeeto/w64devkit/releases

https://github.com/niXman/mingw-builds-binaries/releases

llama.cpp

下载

shell 复制代码

git clone https://github.com/ggml-org/llama.cpp.git
# git clone https://gitclone.com/github.com/ggerganov/llama.cpp

编译

shell 复制代码

cmake -B build -G "MinGW Makefiles" -DLLAMA_CURL=OFF -DGGML_CUDA=OFF
cmake --build build -j32