Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

被引:741
作者
Wang, Xintao [1 ]
Xie, Liangbin [2 ,3 ,5 ]
Dong, Chao [2 ,4 ]
Shan, Ying [1 ]
机构
[1] Tencent PCG, Appl Res Ctr ARC, Beijing, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai AI Lab, Shanghai, Peoples R China
[5] Tencent PCG, Appl Res Ctr, Beijing, Peoples R China
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) | 2021年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCVW54120.2021.00217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.
引用
收藏
页码:1905 / 1914
页数:10
相关论文
共 55 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
[Anonymous], 2016, CVPR, DOI DOI 10.1109/CVPR.2016.186
[3]  
[Anonymous], 2018, COMP VIS ECCV 2018 W, DOI DOI 10.1163/9789004385580002
[4]  
[Anonymous], 2018, CVPR, DOI DOI 10.1109/CVPR.2018.00652
[5]  
[Anonymous], 2018, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2018.00262
[6]   Clinically Translatable Formulation Strategies for Systemic Administration of Nerve-Specific Probes [J].
Barth, Connor W. ;
Shah, Vidhi M. ;
Wang, Lei G. ;
Antaris, Alexander L. ;
Klaassen, Alwin ;
Sorger, Jonathan ;
Rao, Deepa A. ;
Kerr, Darcy A. ;
Henderson, Eric R. ;
Alani, Adam W. G. ;
Gibbs, Summer L. .
ADVANCED THERAPEUTICS, 2021, 4 (07)
[7]  
Bell-Kligler Sefi, 2019, NEURIPS
[8]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[9]   Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Model [J].
Cai, Jianrui ;
Zeng, Hui ;
Yong, Hongwei ;
Cao, Zisheng ;
Zhang, Lei .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3086-3095
[10]  
Chan K.C., 2021, CVPR