Multi-scale generative adversarial network for image super-resolution

被引:51
作者
Daihong, Jiang [1 ]
Sai, Zhang [2 ]
Lei, Dai [1 ]
Yueming, Dai [1 ]
机构
[1] Xuzhou Univ Technol, Xuzhou 221000, Peoples R China
[2] China Univ Min & Technol, Xuzhou 221000, Peoples R China
关键词
Image super-resolution; Multi-scale; Generative adversarial network; Compression activation module;
D O I
10.1007/s00500-022-06822-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, deep convolutional neural networks (CNNs) have been widely employed in image super-resolution. Thanks to the power of deep CNNs, the reconstruction performance is largely improved. However, the high-frequency information and details in the low-resolution image still can hardly be reconstructed. To deal with the above problems, we propose a multi-scale generative adversarial network in this paper. The multi-scale Pyramid module inside the generator could extract the features containing high-frequency information, and then the high-resolution image with the results of the bicubic interpolations is reconstructed. The discriminator in our model is used to identify the authenticity of the input image after refactoring. Our final loss function includes an adversarial loss and the mean square error (L2) reconstruction loss. In order to further improve the efficiency of training, the generator is pre-trained with the L2 loss, so as to improve the efficiency of the discriminator optimization. Compared with the algorithms based solely on normal plain convolutional networks, the proposed algorithm performs better in two indexes PSNR and SSIM of the super-resolution task.
引用
收藏
页码:3631 / 3641
页数:11
相关论文
共 37 条
[31]   Deep Networks for Image Super-Resolution with Sparse Prior [J].
Wang, Zhaowen ;
Liu, Ding ;
Yang, Jianchao ;
Han, Wei ;
Huang, Thomas .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :370-378
[32]  
Wu B., 2017, Srpgan: Perceptual generative adversarial network for single image super resolution
[33]   Image Super-Resolution Via Sparse Representation [J].
Yang, Jianchao ;
Wright, John ;
Huang, Thomas S. ;
Ma, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (11) :2861-2873
[34]   Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networks [J].
Yuan, Yuan ;
Liu, Siyuan ;
Zhang, Jiawei ;
Zhang, Yongbing ;
Dong, Chao ;
Lin, Liang .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :814-823
[35]  
Zeyde R., 2012, Curves and Surfaces, P711
[36]   A super-resolution reconstruction algorithm for surveillance images [J].
Zhang, Liangpei ;
Zhang, Hongyan ;
Shen, Huanfeng ;
Li, Pingxiang .
SIGNAL PROCESSING, 2010, 90 (03) :848-859
[37]  
Zhao T, 2018, ARXIV181204240 CORR