FG-SRGAN: A Feature-Guided Super-Resolution Generative Adversarial Network for Unpaired Image Super-Resolution

被引:8
作者
Lian, Shuailong [1 ]
Zhou, Hejian [1 ]
Sun, Yi [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian, Peoples R China
来源
ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT I | 2019年 / 11554卷
基金
中国国家自然科学基金;
关键词
Image super-resolution; Unsupervised learning; GAN;
D O I
10.1007/978-3-030-22796-8_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the performance of single image super-resolution has been significantly improved by convolution neural networks (CNN). However, most of these networks are trained with paired images and take the bicubic-downsampled images as inputs. It's impractical if we want to super-resolve low-resolution images in the real world, since there is no ground truth high-resolution images corresponding to the low-resolution images. To tackle this challenge, a Feature-Guided Super-Resolution Generative Adversarial Network (FG-SRGAN) for unpaired image super-resolution is proposed in this paper. A guidance module is introduced in FG-SRGAN, which is utilized to reduce the space of possible mapping functions and help to learn the correct mapping function from low-resolution domain to high-resolution domain. Furthermore, we treat the outputs of guidance module as fake examples, which can be leveraged using another adversarial loss. This is beneficial for the main task as it forces FG-SRGAN to learn valid representations for super-resolution. When applied to super-resolve low-resolution face images in the real world, FG-SRGAN is able to achieve satisfactory performance both qualitatively and quantitatively.
引用
收藏
页码:151 / 161
页数:11
相关论文
共 26 条
[1]  
[Anonymous], 2018, ARXIV180900219
[2]  
[Anonymous], 2016, P C C WORKSH NEUR IN
[3]   To Learn Image Super-Resolution, Use a GAN to Learn How to Do Image Degradation First [J].
Bulat, Adrian ;
Yang, Jing ;
Tzimiropoulos, Georgios .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :187-202
[4]   How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) [J].
Bulat, Adrian ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1021-1030
[5]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[6]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622
[8]   Image Super-Resolution via Dual-State Recurrent Networks [J].
Han, Wei ;
Chang, Shiyu ;
Liu, Ding ;
Yu, Mo ;
Witbrock, Michael ;
Huang, Thomas S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1654-1663
[9]  
Hensel M, 2017, ADV NEUR IN, V30
[10]   Fast and Accurate Single Image Super-Resolution via Information Distillation Network [J].
Hui, Zheng ;
Wang, Xiumei ;
Gao, Xinbo .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :723-731