Stable Diffusion中Lora【草稿】

Lora

Lora (Low-rank Adaption)

Lora通过两个较小的矩阵AB以低秩训练更新 Δ W \Delta W ΔW。

参考
LoRA: Low-Rank Adaptation of Large Language Models

https://zhuanlan.zhihu.com/p/697925142