Image super-resolution reconstruction based on feature map attention mechanism

被引:191
作者
Chen, Yuantao [1 ,2 ]
Liu, Linwu [1 ,2 ]
Phonevilay, Volachith [1 ,2 ]
Gu, Ke [1 ]
Xia, Runlong [3 ]
Xie, Jingbo [3 ]
Zhang, Qian [4 ]
Yang, Kai [4 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Hunan Prov Key Lab Intelligent Proc Big Data Tran, Changsha 410114, Hunan, Peoples R China
[3] Hunan Inst Sci & Tech Informat, Changsha 410001, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technol Corp Ltd, Dept Elect Prod, Changsha 410005, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution reconstruction; Feature map attention mechanism; Multiple information extraction; Deep learning methods; Multi-scale low-resolution images; ALGORITHM; NETWORK;
D O I
10.1007/s10489-020-02116-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To improve the issue of low-frequency and high-frequency components from feature maps being treated equally in existing image super-resolution reconstruction methods, the paper proposed an image super-resolution reconstruction method using attention mechanism with feature map to facilitate reconstruction from original low-resolution images to multi-scale super-resolution images. The proposed model consists of a feature extraction block, an information extraction block, and a reconstruction module. Firstly, the extraction block is used to extract useful features from low-resolution images, with multiple information extraction blocks being combined with the feature map attention mechanism and passed between feature channels. Secondly, the interdependence is used to adaptively adjust the channel characteristics to restore more details. Finally, the reconstruction module reforms different scales high-resolution images. The experimental results can demonstrate that the proposed method can effectively improve not only the visual effect of images but also the results on the Set5, Set14, Urban100, and Manga109. The results can demonstrate the proposed method has structurally similarity to the image reconstruction methods. Furthermore, the evaluating indicator of Peak Signal to Noise Ratio (PSNR) and Structural Similarity Index (SSIM) has been improved to a certain degree, while the effectiveness of using feature map attention mechanism in image super-resolution reconstruction applications is useful and effective.
引用
收藏
页码:4367 / 4380
页数:14
相关论文
共 37 条
[1]  
Chen YB, 2020, J CONTEMP CHINA, V29, P1, DOI [10.1007/s12652-020-02066-z, 10.1080/10670564.2019.1621526, 10.1080/01932691.2020.1791172]
[2]   Freeze-Drying Formulations Increased the Adenovirus and Poxvirus Vaccine Storage Times and Antigen Stabilities [J].
Chen, Ye ;
Liao, Qibin ;
Chen, Tianyue ;
Zhang, Yuchao ;
Yuan, Weien ;
Xu, Jianqing ;
Zhang, Xiaoyan .
VIROLOGICA SINICA, 2021, 36 (03) :365-372
[3]   The face image super-resolution algorithm based on combined representation learning [J].
Chen, Yuantao ;
Phonevilay, Volachith ;
Tao, Jiajun ;
Chen, Xi ;
Xia, Runlong ;
Zhang, Qian ;
Yang, Kai ;
Xiong, Jie ;
Xie, Jingbo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (20) :30839-30861
[4]   Research on image inpainting algorithm of improved total variation minimization method [J].
Chen, Yuantao ;
Zhang, Haopeng ;
Liu, Linwu ;
Tao, Jiajun ;
Zhang, Qian ;
Yang, Kai ;
Xia, Runlong ;
Xie, Jingbo .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 14 (5) :5555-5564
[5]   Research on image Inpainting algorithm of improved GAN based on two-discriminations networks [J].
Chen, Yuantao ;
Zhang, Haopeng ;
Liu, Linwu ;
Chen, Xi ;
Zhang, Qian ;
Yang, Kai ;
Xia, Runlong ;
Xie, Jingbo .
APPLIED INTELLIGENCE, 2021, 51 (06) :3460-3474
[6]   The image annotation algorithm using convolutional features from intermediate layer of deep learning [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Chen, Xi ;
Xia, Runlong ;
Zhang, Qian ;
Xiong, Jie ;
Yang, Kai ;
Xie, Jingbo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (03) :4237-4261
[7]   A novel online incremental and decremental learning algorithm based on variable support vector machine [J].
Chen, Yuantao ;
Xiong, Jie ;
Xu, Weihong ;
Zuo, Jingwen .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3) :S7435-S7445
[8]   RETRACTED: Multiscale fast correlation filtering tracking algorithm based on a feature fusion model (Retracted article. See vol. 34, 2022) [J].
Chen, Yuantao ;
Wang, Jin ;
Liu, Songjie ;
Chen, Xi ;
Xiong, Jie ;
Xie, Jingbo ;
Yang, Kai .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (15)
[9]   RETRACTED: Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks (Retracted article. See vol. 11, 2021) [J].
Chen, Yuantao ;
Wang, Jin ;
Chen, Xi ;
Sangaiah, Arun Kumar ;
Yang, Kai ;
Cao, Zhouhong .
APPLIED SCIENCES-BASEL, 2019, 9 (11)
[10]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066