【人工智能】【Python】离线环境下huggingface预训练权重导入流程

说明:在离线环境下,使用timm或者其他包通过huggingface下载预训练权重会报类似如下的错误:

复制代码
File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_factory.py", line 126, in create_model model = create_fn( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/swin_transformer.py", line 988, in swin_tiny_patch4_window7_224 return _create_swin_transformer( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/swin_transformer.py", line 888, in _create_swin_transformer model = build_model_with_cfg( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_builder.py", line 436, in build_model_with_cfg load_pretrained( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_builder.py", line 213, in load_pretrained state_dict = load_state_dict_from_hf(pretrained_loc, weights_only=True, cache_dir=cache_dir) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/timm/models/_hub.py", line 225, in load_state_dict_from_hf cached_file = hf_hub_download( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 961, in hf_hub_download return _hf_hub_download_to_cache_dir( File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1068, in _hf_hub_download_to_cache_dir _raise_on_head_call_error(head_call_error, force_download, local_files_only) File "/myvar/docker/home/cqai/miniconda3/envs/jz-shiftingnet/lib/python3.9/site-packages/huggingface_hub/file_download.py", line 1599, in _raise_on_head_call_error raise LocalEntryNotFoundError( huggingface_hub.errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.

这时我们可以在联网的电脑上下载好后复制过去。

查看预训练权重文件夹位置,运行以下命令:

复制代码
python -c "from huggingface_hub import hf_hub_download; import os; print(os.path.expanduser('~/.cache/huggingface/hub'))"

我这边是从Windows11端复制到Linux服务器上,其他情况操作也是一样的。

全部复制过去即可,或者挑选指定的预训练权重,完成后重新运行训练脚本,可见成功开始训练:

相关推荐
神明9311 小时前
React 中父组件向子组件传递函数的正确调用方式
jvm·数据库·python
qiyongwork1 小时前
智能项目管理信息系统的未来图景:AI赋能下的全链路革新与生态重构
大数据·人工智能·重构
wang3zc1 小时前
TensorFlow如何进行张量维度重塑_使用tf.reshape或tf.expand_dims
jvm·数据库·python
wanhengidc1 小时前
云手机的兼容性与稳定性
大数据·运维·服务器·网络·人工智能·智能手机
昇腾CANN1 小时前
5月12日直播丨Ascend 950 HiF8模型量化技术的训推实践
人工智能·昇腾·cann
winlife_1 小时前
AI 怎么验证 Unity PlayMode 行为:截图 + 输入模拟的完整闭环
人工智能·unity·游戏引擎·ai编程·claude·playmode
Harvy_没救了1 小时前
【github 爆款】Agent Skill项目全景汇报 + 联动deepseek-TUI
人工智能·github
2501_901200531 小时前
mysql如何检查数据库表是否存在损坏_使用CHECK TABLE命令修复
jvm·数据库·python
2301_766283441 小时前
如何设置密码复杂度策略以约束MongoDB用户的密码强度
jvm·数据库·python