LLaMA Factory环境配置

陆逊_字伯言2024-10-23 18:33

LLaMA-Factory官方文档

安装正确的torch和cuda版本

参考：

PyTorch

报错解决

1.ImportError: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29` not found

参考这个解决：丝滑解决ImportError: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found问题

2.flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c105ErrorC2ENS_14SourceLocationENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

参考这个重新安装flash-attention:

$已解决$ flash-attn报错flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol-CSDN博客

安装flash-attention

3.python3.11/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: symbol __nvJitLinkComplete_12_4 version libnvJitLink.so.12 not defined in file libnvJitLink.so.12 with link time reference

torch包坏了，重装torch

4.cannot import name 'log' from 'torch.distributed.elastic.agent.server.api'

成功解决ImportError: cannot import name 'log' from 'torch.distributed.elastic.agent.server.api'_importerror: cannot import name 'log' from 'torch.-CSDN博客