Multi-scale generative adversarial network for image super-resolution

被引:44
作者
Daihong, Jiang [1 ]
Sai, Zhang [2 ]
Lei, Dai [1 ]
Yueming, Dai [1 ]
机构
[1] Xuzhou Univ Technol, Xuzhou 221000, Peoples R China
[2] China Univ Min & Technol, Xuzhou 221000, Peoples R China
关键词
Image super-resolution; Multi-scale; Generative adversarial network; Compression activation module;
D O I
10.1007/s00500-022-06822-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, deep convolutional neural networks (CNNs) have been widely employed in image super-resolution. Thanks to the power of deep CNNs, the reconstruction performance is largely improved. However, the high-frequency information and details in the low-resolution image still can hardly be reconstructed. To deal with the above problems, we propose a multi-scale generative adversarial network in this paper. The multi-scale Pyramid module inside the generator could extract the features containing high-frequency information, and then the high-resolution image with the results of the bicubic interpolations is reconstructed. The discriminator in our model is used to identify the authenticity of the input image after refactoring. Our final loss function includes an adversarial loss and the mean square error (L2) reconstruction loss. In order to further improve the efficiency of training, the generator is pre-trained with the L2 loss, so as to improve the efficiency of the discriminator optimization. Compared with the algorithms based solely on normal plain convolutional networks, the proposed algorithm performs better in two indexes PSNR and SSIM of the super-resolution task.
引用
收藏
页码:3631 / 3641
页数:11
相关论文
共 37 条
[21]   Component Semantic Prior Guided Generative Adversarial Network for Face Super-Resolution [J].
Liu, Lu ;
Wang, Shenghui ;
Wan, Lili .
IEEE ACCESS, 2019, 7 :77027-77036
[22]   Unsupervised Learning for Real-World Super-Resolution [J].
Lugmayr, Andreas ;
Danelljan, Martin ;
Timofte, Radu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :3408-3416
[23]  
Martin D, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P416, DOI 10.1109/ICCV.2001.937655
[24]   JCS-Net: Joint Classification and Super-Resolution Network for Small-Scale Pedestrian Detection in Surveillance Images [J].
Pang, Yanwei ;
Cao, Jiale ;
Wang, Jian ;
Han, Jungong .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2019, 14 (12) :3322-3331
[25]  
Peled S, 2001, MAGN RESON MED, V45, P29, DOI 10.1002/1522-2594(200101)45:1<29::AID-MRM1005>3.0.CO
[26]  
2-Z
[27]   SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation [J].
Son, Sanghyun ;
Lee, Kyoung Mu .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7778-7787
[28]   Super Resolution Reconstruction of Images Based on Interpolation and Full Convolutional Neural Network and Application in Medical Fields [J].
Sun, Na ;
Li, Huina .
IEEE ACCESS, 2019, 7 :186470-186479
[29]   Exploring Sparsity in Image Super-Resolution for Efficient Inference [J].
Wang, Longguang ;
Dong, Xiaoyu ;
Wang, Yingqian ;
Ying, Xinyi ;
Lin, Zaiping ;
An, Wei ;
Guo, Yulan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4915-4924
[30]  
Wang XP, 2018, IDEAS HIST MOD CHINA, V19, P1, DOI 10.1163/9789004385580_002