Multi-scale generative adversarial network for image super-resolution

被引:44
作者
Daihong, Jiang [1 ]
Sai, Zhang [2 ]
Lei, Dai [1 ]
Yueming, Dai [1 ]
机构
[1] Xuzhou Univ Technol, Xuzhou 221000, Peoples R China
[2] China Univ Min & Technol, Xuzhou 221000, Peoples R China
关键词
Image super-resolution; Multi-scale; Generative adversarial network; Compression activation module;
D O I
10.1007/s00500-022-06822-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, deep convolutional neural networks (CNNs) have been widely employed in image super-resolution. Thanks to the power of deep CNNs, the reconstruction performance is largely improved. However, the high-frequency information and details in the low-resolution image still can hardly be reconstructed. To deal with the above problems, we propose a multi-scale generative adversarial network in this paper. The multi-scale Pyramid module inside the generator could extract the features containing high-frequency information, and then the high-resolution image with the results of the bicubic interpolations is reconstructed. The discriminator in our model is used to identify the authenticity of the input image after refactoring. Our final loss function includes an adversarial loss and the mean square error (L2) reconstruction loss. In order to further improve the efficiency of training, the generator is pre-trained with the L2 loss, so as to improve the efficiency of the discriminator optimization. Compared with the algorithms based solely on normal plain convolutional networks, the proposed algorithm performs better in two indexes PSNR and SSIM of the super-resolution task.
引用
收藏
页码:3631 / 3641
页数:11
相关论文
共 37 条
[1]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[2]   To Learn Image Super-Resolution, Use a GAN to Learn How to Do Image Degradation First [J].
Bulat, Adrian ;
Yang, Jing ;
Tzimiropoulos, Georgios .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :187-202
[3]   Noisy practical facial super-resolution method via deformable constrained model with small dataset [J].
Chen, Liang ;
Li, Qing ;
Jiang, Junjun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (3-4) :2577-2600
[4]   Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search [J].
Chu, Xiangxiang ;
Zhang, Bo ;
Ma, Hailong ;
Xu, Ruijun ;
Li, Qingyuan .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :59-64
[5]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[6]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[7]  
Fattal R, 2007, ACM T GRAPHIC, V26, DOI [10.1145/1276377.1276496, 10.1145/1239451.1239546]
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   Eigenface-domain super-resolution for face recognition [J].
Gunturk, BK ;
Batur, AU ;
Altunbasak, Y ;
Hayes, MH ;
Mersereau, RM .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (05) :597-606
[10]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673