MULTIRESOLUTION MIXTURE GENERATIVE ADVERSARIAL NETWORK FOR IMAGE SUPER-RESOLUTION

被引:0
作者
Wang, Yudiao [1 ]
Lan, Xuguang [2 ]
Zhang, Yinshu [1 ]
Miao, Ruixue [3 ]
Tian, Zhiqiang [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software, Xian, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian, Shaanxi, Peoples R China
[3] Northeast Normal Univ, Sch Informat Sci & Technol, Changchun, Jilin, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) | 2020年
关键词
generative adversarial network; multi-resolution mixture network; residual fluctuation loss; super-resolution;
D O I
10.1109/icme46284.2020.9102972
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With regard to the problem of image super-resolution (SR), generative adversarial network (GAN) can make generated images have more details and better effect on perceptual quality than other methods. However, GAN-based methods may lose the contour of object in some texture-intensive areas. In order to recover contour better and further enhance perceptual quality, we propose a Multiresolution Mixture Generative Adversarial Network for Image Super-Resolution (MRMGAN), which employs a multiresolution mixture network (MRMNet) for image super-resolution. The MRMNet is able to have multiple resolution feature maps at the same time when training. Meanwhile, we propose a residual fluctuation loss, which aims to reduce the overall fluctuation of residual between SR image and high-resolution (HR) image. We evaluated the proposed method on benchmark datasets. Experimental results show that the proposed MRMGAN can get satisfactory performance.
引用
收藏
页数:6
相关论文
共 25 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
[Anonymous], 2015, ACS SYM SER
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[5]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[6]   Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation [J].
Ghifary, Muhammad ;
Kleijn, W. Bastiaan ;
Zhang, Mengjie ;
Balduzzi, David ;
Li, Wen .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :597-613
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]   Meta-SR: A Magnification-Arbitrary Network for Super-Resolution [J].
Hu, Xuecai ;
Mu, Haoyuan ;
Zhang, Xiangyu ;
Wang, Zilei ;
Tan, Tieniu ;
Sun, Jian .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1575-1584
[9]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[10]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711