Image Super-Resolution Reconstruction Based on a Generative Adversarial Network

被引:4
作者
Wu, Yun [1 ]
Lan, Lin [1 ]
Long, Huiyun [1 ]
Kong, Guangqian [1 ]
Duan, Xun [1 ]
Xu, Changzhuan [1 ]
机构
[1] Guizhou Univ, Sch Comp Sci & Technol, Guiyang 550025, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; dual network structure; generative adversarial network; perceptual loss; super-resolution;
D O I
10.1109/ACCESS.2020.3040424
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of computer vision, super-resolution reconstruction techniques based on deep learning have undergone considerable advancement; however, certain limitations remain, such as insufficient feature extraction and blurred image generation. To address these problems, we propose an image superresolution reconstruction model based on a generative adversarial network. First, we employ a dual network structure in the generator network to solve the problem of insufficient feature extraction. The dual network structure is divided into an upsample subnetwork and a refinement subnetwork, which upsample and optimize a low-resolution image, respectively. In a scene with large upscaling factors, this structure can reduce the negative effect of noise and enhance the utilization of high-frequency details, thereby generating highquality reconstruction results. Second, to generate sharper super-resolution images, we use the perceptual loss, which exhibits a fast convergence and excellent visual effect, to guide the generator network training. We apply the ResNeXt-50-32x4d network, which has few parameters and a large depth, to calculate the loss to obtain a reconstructed super-resolution image that is highly realistic. Finally, we introduce theWasserstein distance into the discriminator network to enhance the discrimination ability and stability of the model. Specifically, this distance is employed to eliminate the activation function in the last layer of the network and avoid the use of the logarithm in calculating the loss function. Extensive experiments on the DIV2K, Set5, Set14, and BSD100 datasets demonstrate the effectiveness of the proposed model.
引用
收藏
页码:215133 / 215144
页数:12
相关论文
共 29 条
[1]  
[Anonymous], representation learning with deep convolutional generative
[2]  
[Anonymous], ICML
[3]  
[Anonymous], 2017, P INT C LEARN REPR
[4]   The image annotation algorithm using convolutional features from intermediate layer of deep learning [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Chen, Xi ;
Xia, Runlong ;
Zhang, Qian ;
Xiong, Jie ;
Yang, Kai ;
Xie, Jingbo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (03) :4237-4261
[5]   The improved image inpainting algorithm via encoder and similarity constraint [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Xia, Runlong ;
Zhang, Qian ;
Yang, Kai ;
Xiong, Jie ;
Chen, Xi .
VISUAL COMPUTER, 2021, 37 (07) :1691-1705
[6]   Saliency Detection via the Improved Hierarchical Principal Component Analysis Method [J].
Chen, Yuantao ;
Tao, Jiajun ;
Zhang, Qian ;
Yang, Kai ;
Chen, Xi ;
Xiong, Jie ;
Xia, Runlong ;
Xie, Jingbo .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
[7]   RETRACTED: Multiscale fast correlation filtering tracking algorithm based on a feature fusion model (Retracted article. See vol. 34, 2022) [J].
Chen, Yuantao ;
Wang, Jin ;
Liu, Songjie ;
Chen, Xi ;
Xiong, Jie ;
Xie, Jingbo ;
Yang, Kai .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (15)
[8]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[9]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[10]  
Goodfellow I., 2014, 27THINT C NEURAL INF, V2, P2672