- 先看第一篇LaMa模型的使用, 再往下看下面的内容:
超简单搭建AI去水印和图像修复算法lama-cleaner(包含网页UI单张操作和代码批量运行)一

7.其他算法模型调用和使用(可以自行选择模型, 调试哪个效果更好)
其他不同模型测试的效果与LaMa的对比:
bash
效果:LDM > LaMa
速度:LDM更慢
特点:比LaMa有更好、更多的细节
效果:ZITS > LaMa
速度:ZITS更慢
特点:能在高分辨弱纹理场景中,恢复关键的边缘和线框
效果:MAT 和 LaMa 差不多
速度:MAT稍慢一些
特点:大面积像素缺失的补全, 并提供多样性生成(会大幅改变原始图的特征)
效果:FcF > LaMa
速度:差不多
特点:能生成更好的结构和纹理, 但只能支持512x512的输入
效果:Manga > LaMa (在漫画图上的效果)
速度:差不多
特点:能生成更好的结构和纹理, 但只能支持512x512的输入在漫画图像上表现的比LaMa模型效果更好
7.1 LDM模型
bash
github:https://github.com/CompVis/latent-diffusion
paper:https://arxiv.org/abs/2112.10752
--model=ldm
LDM模型手动下载:
(1) https://github.com/Sanster/models/releases/download/add_ldm/diffusion.pt、
(2) https://github.com/Sanster/models/releases/download/add_ldm/cond_stage_model_decode.pt
(3) https://github.com/Sanster/models/releases/download/add_ldm/cond_stage_model_encode.pt
7.2 ZITS模型
bash
github:https://github.com/DQiaole/ZITS_inpainting
paper:https://arxiv.org/abs/2203.00867
--model=zits
ZITS模型手动下载:
https://github.com/Sanster/models/releases/download/add_zits/zits-wireframe-0717.pt
https://github.com/Sanster/models/releases/download/add_zits/zits-edge-line-0717.pt
https://github.com/Sanster/models/releases/download/add_zits/zits-structure-upsample-0717.pt
https://github.com/Sanster/models/releases/download/add_zits/zits-inpaint-0717.pt
7.3 MAT模型
bash
github:https://github.com/fenglinglwb/MAT
paper:https://arxiv.org/abs/2203.15270
--model=mat
MAT模型手动下载:
https://github.com/Sanster/models/releases/download/add_mat/Places_512_FullData_G.pth
7.4 FcF模型
bash
github:https://github.com/SHI-Labs/FcF-Inpainting
paper:https://arxiv.org/abs/2208.03382
--model=fcf
FcF模型手动下载:
https://github.com/Sanster/models/releases/download/add_fcf/places_512_G.pth
7.5 Manga模型
bash
Manga模型
github:https://github.com/msxie92/MangaInpainting
paper:https://www.cse.cuhk.edu.hk/~ttwong/papers/mangainpaint/mangainpaint.html
--model=manga
Manga模型手动下载:
https://github.com/Sanster/models/releases/download/manga/erika.jit
https://github.com/Sanster/models/releases/download/manga/manga_inpaintor.jit