【人工智能】【Python】离线环境下huggingface预训练权重导入流程

说明:在离线环境下,使用timm或者其他包通过huggingface下载预训练权重会报类似如下的错误:

复制代码
File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_factory.py", line 126, in create_model model = create_fn( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/swin_transformer.py", line 988, in swin_tiny_patch4_window7_224 return _create_swin_transformer( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/swin_transformer.py", line 888, in _create_swin_transformer model = build_model_with_cfg( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_builder.py", line 436, in build_model_with_cfg load_pretrained( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_builder.py", line 213, in load_pretrained state_dict = load_state_dict_from_hf(pretrained_loc, weights_only=True, cache_dir=cache_dir) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_hub.py", line 225, in load_state_dict_from_hf cached_file = hf_hub_download( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 961, in hf_hub_download return _hf_hub_download_to_cache_dir( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1068, in _hf_hub_download_to_cache_dir _raise_on_head_call_error(head_call_error, force_download, local_files_only) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1599, in _raise_on_head_call_error raise LocalEntryNotFoundError( huggingface_hub.errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.

这时我们可以在联网的电脑上下载好后复制过去。

查看预训练权重文件夹位置,运行以下命令:

复制代码
python -c "from huggingface_hub import hf_hub_download; import os; print(os.path.expanduser('~/.cache/huggingface/hub'))"

我这边是从Windows11端复制到Linux服务器上,其他情况操作也是一样的。

全部复制过去即可,或者挑选指定的预训练权重,完成后重新运行训练脚本,可见成功开始训练:

相关推荐
星核0penstarry2 分钟前
DeepSeek-V4-Flash 正式公测:大模型行业进入「极速平价普惠时代」
java·开发语言·人工智能
qq_22589174662 分钟前
基于Python的中药药材数据可视化分析系统
python·机器学习·数据分析·django
老洋葱Mr_Onion3 分钟前
【C++】高精度模板
开发语言·c++·算法
小沈同学呀6 分钟前
【Agent开发第三期】短期记忆history,让模型“记住“上一句
人工智能·ai编程·agent开发·agent记忆
卷无止境24 分钟前
LangExtract:让LLM从杂乱文本中"抠"出结构化数据的开源工具
后端·python
Elastic 中国社区官方博客25 分钟前
Elasticsearch:搜索教程 - 语义搜索(三)
大数据·数据库·人工智能·elasticsearch·搜索引擎·ai·全文检索
utmhikari28 分钟前
【AI原生】用AI-Native的方式编写SRE告警诊断Agent和Skill
人工智能·agent·稳定性·ai-native·sre·skill·rca
脚踏实地皮皮晨29 分钟前
003003002_WPF Grid 基类官方类定义逐行深度解析
开发语言·windows·算法·c#·wpf·visual studio
栈溢出的浪漫30 分钟前
码界领航:Python拓界-机器学习Web跨平台
python·机器学习·跨平台·web开发·个人项目
xieliyu.30 分钟前
Java 线程池入门详解:线程池基础定义 + ThreadPoolExecutor 全参构造方法逐参数解析
java·开发语言·idea·javaee