Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

被引:741
作者
Wang, Xintao [1 ]
Xie, Liangbin [2 ,3 ,5 ]
Dong, Chao [2 ,4 ]
Shan, Ying [1 ]
机构
[1] Tencent PCG, Appl Res Ctr ARC, Beijing, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai AI Lab, Shanghai, Peoples R China
[5] Tencent PCG, Appl Res Ctr, Beijing, Peoples R China
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) | 2021年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCVW54120.2021.00217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.
引用
收藏
页码:1905 / 1914
页数:10
相关论文
共 55 条
[21]   DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks [J].
Ignatov, Andrey ;
Kobyshev, Nikolay ;
Timofte, Radu ;
Vanhoey, Kenneth ;
Luc Van Gool .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3297-3305
[22]   Real-World Super-Resolution via Kernel Estimation and Noise Injection [J].
Ji, Xiaozhong ;
Cao, Yun ;
Tai, Ying ;
Wang, Chengjie ;
Li, Jilin ;
Huang, Feiyue .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1914-1923
[23]   Study of Soiling Loss on Photovoltaic Modules With Artificially Deposited Dust of Different Gravimetric Densities and Compositions Collected From Different Locations in India [J].
John, Jim J. ;
Warade, Sonali ;
Tamizhmani, Govindasamy ;
Kottantharayil, Anil .
IEEE JOURNAL OF PHOTOVOLTAICS, 2016, 6 (01) :236-243
[24]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[25]   Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5835-5843
[26]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114
[27]  
Lee JK, 2016, P IEEE C COMP VIS PA
[28]  
Lim Bee, 2017, CVPRW
[29]  
Liu Anran, 2021, ARXIV210703055
[30]   Perspectives on Electron-Assisted Reduction for Preparation of Highly Dispersed Noble Metal Catalysts [J].
Liu, Chang-Jun ;
Zhao, Yue ;
Li, Yingzhi ;
Zhang, Da-Shuai ;
Chang, Ze ;
Bu, Xian-He .
ACS SUSTAINABLE CHEMISTRY & ENGINEERING, 2014, 2 (01) :3-13