Multi-scale feature aggregation network for Image super-resolution

被引:7
作者
Chen, Wenlong [1 ,2 ]
Yao, Pengcheng [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Da, Feipeng [1 ,2 ,3 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Minist Educ, Key Lab Measurement & Control Complex Syst Engn, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Shenzhen Res Inst, Shenzhen 518063, Guangdong, Peoples R China
关键词
Super-resolution; Multi-path learning; Multi-scale; Convolutional neural network;
D O I
10.1007/s10489-021-02593-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For single image super-resolution technology, Convolutional Neural Network (CNN) has an excellent capability to improve reconstruction results. However, the existing CNN-based SR methods maintain high-quality reconstruction with excessive amounts of parameters and very deep network structures, which not only leads to higher requirements for computational resource and memory storage but also makes it difficult to apply resource-constrained devices. To solve these problems, a multi-scale feature aggregation network (MFAN) is proposed in this paper. In the MFAN, global dual-path is put into use to forward the feature information in low resolution space and medium resolution space respectively. For the sake of enhancing the ability of MFAN feature extraction, we come up a with multi-scale feature extraction module (MSFE), which also contains a multi-path structure. This module is embedded in each global path for image feature extraction. Through the effective combination of global path and MSFE, multi-scale information is extracted and enhanced step by step. Moreover, we design an inter-scale feature projection module (ISFP) based on the back-projection mechanism to effectively integrate the multi-scale feature information from MSFE. Extensive experiments show that the proposed MFAN has achieved competitive results in the qualitative and quantitative evaluation.
引用
收藏
页码:3577 / 3586
页数:10
相关论文
共 40 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[4]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[5]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[6]   Suppressing Model Overfitting for Image Super-Resolution Networks [J].
Feng, Ruicheng ;
Gu, Jinjin ;
Qiao, Yu ;
Dong, Chao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :1964-1973
[7]   Multi-scale fractal residual network for image super-resolution [J].
Feng, Xinxin ;
Li, Xianguo ;
Li, Jianxiong .
APPLIED INTELLIGENCE, 2021, 51 (04) :1845-1856
[8]   Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution [J].
Guo, Yong ;
Chen, Jian ;
Wang, Jingdong ;
Chen, Qi ;
Cao, Jiezhang ;
Deng, Zeshuai ;
Xu, Yanwu ;
Tan, Mingkui .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5406-5415
[9]   Image Super-Resolution via Dual-State Recurrent Networks [J].
Han, Wei ;
Chang, Shiyu ;
Liu, Ding ;
Yu, Mo ;
Witbrock, Michael ;
Huang, Thomas S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1654-1663
[10]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673