【GPT入门】第47课 LlamaFacotory 合并原模型与LoRA模型

【GPT入门】第47课 LlamaFacotory 合并原模型与LoRA模型

1.合并原模型与LoRA训练的增量模型

  • llamafactory-cli webui 执行合并
  • 合并后模型大小

    (base) root@autodl-container-b4b04ea4f2-b5ee47d1:~# du -sh /root/autodl-tmp/models/*
    15G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1
    15G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged
    15G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui

  • 模型文件详情

    (base) root@autodl-container-b4b04ea4f2-b5ee47d1:~# du -sh /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/*
    4.0K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/Modelfile
    4.0K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/chat_template.jinja
    4.0K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/config.json
    4.0K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/generation_config.json
    4.7G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00001-of-00004.safetensors
    4.7G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00002-of-00004.safetensors
    4.6G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00003-of-00004.safetensors
    1.1G /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00004-of-00004.safetensors
    24K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model.safetensors.index.json
    4.0K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/special_tokens_map.json
    17M /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/tokenizer.json
    52K /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/tokenizer_config.json

2. 测试模型