关于ollama 在mac的部署问题

东哥爱编程2024-09-23 10:20

安装

官网链接

直接按需求下载即可

默认模型下载地址

macOS: ~/.ollama/models

Linux: /usr/share/ollama/.ollama/models

Windows: C:\Users<username>.ollama\models

根据需要的平台设置相应的环境变量： OLLAMA_MODELS

如Mac 设置～/.zshrc

c 复制代码

export  OLLAMA_MODELS = "/your_path/"

接着运行命令 ollama run qwen2:7b

可以开始本地大模型了

c 复制代码

path_helper: ndk.path.save: Permission denied
(base) chendongming@chendongmingdeMac-mini ~ % ollama run qwen2:7b
pulling manifest 
pulling 43f7a214e532... 100% ▕██████████████████████████████████████████████████████████▏ 4.4 GB                         
pulling 77c91b422cc9... 100% ▕██████████████████████████████████████████████████████████▏ 1.4 KB                         
pulling c156170b718e... 100% ▕██████████████████████████████████████████████████████████▏  11 KB                         
pulling f02dd72bb242... 100% ▕██████████████████████████████████████████████████████████▏   59 B                         
pulling 75357d685f23... 100% ▕██████████████████████████████████████████████████████████▏   28 B                         
pulling 648f809ced2b... 100% ▕██████████████████████████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
success 
>>> hello
Hello! How can I help you today? Is there something specific you would like to know or discuss? I'm here to answer 
any questions you might have, whether they're about general knowledge, specific topics, or just need advice on 
certain issues. Feel free to ask anything you'd like.