转眼做人脸复原(face restoration)算法也一段时间了，根据自己的记忆整理一下自己的一些看法，算作个人记录，当然如果有人愿意分享自己的看法也是极好的。先挂下文章链接，下一篇在写总结。
一、前述
人脸修复(face restoration)任务，起源于人脸超分辨率(face super resolution)，可以算是从超分出来的一个分支。作为图像低级任务(low level)中的一个，主要目的就是在低清、受损画质中尽可能的恢复人脸细节。与传统的全图超分的区别在于，人脸是有明确的先验知识在里面的，可以利用这些先验增加模型的信息量，尽可能的恢复人脸的细节。这些先验可以包括面部特征，也称为几何先验（Geometric Prior） ，有基于高清参考人脸的先验（Reference Prior） ，有基于强的生成器先验（Generative Prior） ，也有基于离散的codebook的先验（Vector Quantized Codebook Prior） ，当然，还有近几年爆火的diffusion，作为强的文生图基本模型，他可以作为一种扩散先验（Diffusion Prior） 。
有趣的是，从超分开始，随着不同的先验在人脸修复中被使用，后续的发展中却出现了不同的轨迹 ，例如几何先验、参考先验、生成式先验、codebook先验，这些在人脸中是效果比较突出的，在超分中比较少用到。但是在最近diffusion的发展中，又慢慢的归为了一个轨迹，所谓天下大势，分久必合，合久必分，感觉有这个味道在了。
二、相关论文及代码整理
原始GitHub仓库： https://github.com/qianx77/Face_Restoration_Ref.git
部分实现：https://github.com/qianx77/Face_Restoration
Geometric Prior
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2018 |
CVPR |
FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors |
[paper][code] |
CNN |
FSRNet |
| 2021 |
TPAMI |
Face Restoration via Plug-and-Play 3D Facial Priors |
[paper][code] |
CNN |
- |
| 2021 |
CVPR |
Progressive Semantic-Aware Style Transformation for Blind Face Restoration |
[paper][code] |
GAN |
PSFRGAN |
| 2023 |
TNNLS |
Multi-prior learning via neural architecture search for blind face restoration |
[paper][code] |
CNN |
MFPSNet |
| 2022 |
CVPR |
Blind Face Restoration via Integrating Face Shape and Generative Priors |
[paper][code] |
GAN |
SGPN |
Reference Prior
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2018 |
ECCV |
Learning Warped Guidance for Blind Face Restoration |
[paper][code] |
CNN |
GFRNet |
| 2020 |
ECCV |
Blind Face Restoration via Deep Multi-scale Component Dictionaries |
[paper][code] |
CNN |
DFDNet |
| 2020 |
CVPR |
Enhanced Blind Face Restoration with Multi-Exemplar Images and Adaptive Spatial Feature Fusion |
[paper][code] |
CNN |
ASFFNet |
| 2022 |
TPAMI |
Learning Dual Memory Dictionaries for Blind Face Restoration |
[paper][code] |
CNN |
DMDNet |
| 2022 |
ACM |
MyStyle: A Personalized Generative Prior |
[paper][code] |
GAN |
MyStyle |
| 2023 |
arXiv |
Personalized Restoration via Dual-Pivot Tuning |
[paper][code] |
Diffusion |
Dual-Pivot Tuning |
| 2024 |
arXiv |
InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention |
[paper][code] |
Diffusion |
InstantRestore |
| 2024 |
CVPR |
PFStorer: Personalized Face Restoration and Super-Resolution |
[paper][code] |
Diffusion |
PFStorer |
| 2024 |
arXiv |
RestorerID: Towards Tuning-Free Face Restoration with ID Preservation |
[paper][code] |
Diffusion |
RestorerID |
| 2024 |
arXiv |
Overcoming False Illusions in Real-World Face Restoration with Multi-Modal GuidedDiffusion Model |
[paper][code] |
Diffusion |
MGFR |
| 2024 |
arXiv |
Copy or Not? Reference-Based Face Image Restoration with Fine Details |
[paper][code] |
Diffusion |
RefineFIR |
| 2024 |
Sensors |
PDGrad: Guiding Diffusion Model for Reference-Based Blind Face Restoration with Pivot Direction Gradient Guidance |
[paper][code] |
Diffusion |
PDGrad |
| 2024 |
CVPR |
Restoration by Generation with Constrained Priors |
[paper][code] |
Diffusion |
gen2res |
| 2024 |
WACV |
ENTED: Enhanced Neural Texture Extraction and Distribution for Reference-based Blind Face Restoration |
[paper][code] |
Diffusion |
ENTED |
| 2025 |
AAAI |
FaceMe: Robust Blind Face Restoration with Personal Identification |
[paper][code] |
Diffusion |
FaceMe |
Generative Prior (good)
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2020 |
MM |
HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment |
[paper][code] |
GAN |
HiFaceGAN |
| 2020 |
CVPR |
Image Processing Using Multi-Code GAN Prior |
[paper][code] |
GAN |
mGANprior |
| 2021 |
CVPR |
Towards Real-World Blind Face Restoration with Generative Facial Prior |
[paper][code] |
GAN |
GFPGAN |
| 2021 |
CVPR |
GAN Prior Embedded Network for Blind Face Restoration in the Wild |
[paper][code] |
GAN |
GPEN |
| 2022 |
CVPR |
Blind Face Restoration via Integrating Face Shape and Generative Priors |
[paper][code] |
GAN |
SGPN |
| 2022 |
CVPR |
GCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors |
[paper][code] |
GAN |
GCFSR |
| 2022 |
AAAI |
Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration |
[paper][code] |
GAN |
Panini-Net |
| 2022 |
Arxiv |
FaceFormer: Scale-aware Blind Face Restoration with Transformers |
[paper][code] |
ViT |
FaceFormer |
| 2022 |
Arxiv |
Blind Face Restoration: Benchmark Datasets and a Baseline Model |
[paper][code] |
ViT |
STUNet |
| 2023 |
CVPR |
TFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation |
[paper][code] |
GAN |
TFRGAN |
| 2023 |
TCSVT |
DEAR-GAN: Degradation-Aware Face Restoration With GAN Prior |
[paper][code] |
GAN |
DEAR-GAN |
| 2023 |
ACMMM |
Exploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration |
[paper][code] |
GAN |
MemGAN |
| 2023 |
FSP |
Degradation Learning and Skip-Transformer for Blind Face Restoration |
[paper][code] |
GAN |
- |
| 2023 |
ACMMM |
Exploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration |
[paper][code] |
GAN |
- |
| 2024 |
AAAI |
Blind Face Restoration under Extreme Conditions: Leveraging 3D-2D Prior Fusion for Superior Structural and Texture Recovery |
[paper][code] |
GAN |
FREx |
Vector Quantized Codebook Prior (good)
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2022 |
CVPR |
RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs |
[paper][code] |
ViT |
RestoreFormer |
| 2022 |
NeurIPS |
Towards Robust Blind Face Restoration with Codebook Lookup Transformer |
[paper][code] |
ViT |
CodeFormer |
| 2022 |
ECCV |
VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder |
[paper][code] |
CNN |
VQFR |
| 2023 |
TPAMI |
RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs |
[paper][code] |
ViT |
RestoreFormer++ |
| 2022 |
CVPR |
Rethinking Deep Face Restoration |
[paper][code] |
GAN |
- |
| 2024 |
ICLR |
Dual Associated Encoder for Face Restoration |
[paper][code] |
ViT |
DAEFR |
Diffusion Prior
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2022 |
Arxiv |
Difface: Blind Face Restoration with Diffused Error Contraction |
[paper][code] |
Diffusion |
DifFace |
| 2023 |
CVPR |
DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration |
[paper][code] |
Diffusion |
DR2 |
| 2023 |
WACV |
AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models |
[paper][code] |
Diffusion |
AT-DDPM |
| 2023 |
ACMMM |
DiffBFR: Bootstrapping Diffusion Model for Blind Face Restoration |
[paper][code] |
Diffusion |
DiffBFR |
| 2023 |
NeurIPS |
PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance |
[paper][code] |
Diffusion |
PGDiff |
| 2024 |
TCSVT |
Towards Real-World Blind Face Restoration with Generative Diffusion Prior |
[paper][code] |
Diffusion |
BFRffusion |
| 2024 |
WACV |
Diffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration |
[paper][code] |
Diffusion |
- |
| 2024 |
ECCV |
DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior |
[paper][code] |
Diffusion |
DiffBIR |
| 2024 |
NeurIPS |
One-Step Effective Diffusion Network for Real-World Image Super-Resolution |
[paper][code] |
Diffusion |
OSEDiff |
| 2024 |
Arxiv |
OSDFace: One-Step Diffusion Model for Face Restoration |
[paper][code] |
Diffusion |
OSDFace |
Others
| Year |
Pub |
Title |
Links |
Arch |
Abbreviation |
| 2023 |
ICCV |
Towards Authentic Face Restoration with Iterative Diffusion Models and Beyond |
[paper][code] |
Diffusion |
IDM |
| 2024 |
CVPR |
WaveFace: Authentic Face Restoration with Efficient Frequency Recovery |
[paper][code] |
Diffusion |
WaveFace |
| 2024 |
Arxiv |
CLR-Face: Conditional Latent Refinement for Blind Face Restoration Using Score-Based Diffusion Models |
[paper][code] |
Diffusion |
CLR-Face |
| 2024 |
WACV |
Diffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration |
[paper][code] |
Diffusion |
Diffuse and Restore |
| 2024 |
arXiv |
AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior |
[paper][code] |
Diffusion |
AuthFace |
| 2025 |
Arxiv |
InfoBFR: Real-World Blind Face Restoration via Information Bottleneck |
[paper][code] |
Diffusion |
InfoBFR |
| 2025 |
WACV |
Towards Unsupervised Blind Face Restoration using Diffusion Prior |
[paper][code] |
Diffusion |
DT-BFR |