Single-image super-resolution via selective multi-scale network

被引:1
作者
He, Zewei [1 ,2 ]
Ding, Binjie [1 ,2 ]
Fu, Guizhong [3 ]
Cao, Yanpeng [1 ,2 ]
Yang, Jiangxin [1 ,2 ]
Cao, Yanlong [1 ,2 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mech Syst, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Sch Mech Engn, Key Lab Adv Mfg Technol Zhejiang Prov, Hangzhou 310027, Peoples R China
[3] Suzhou Univ Sci & Technol, Sch Mech Engn, Suzhou 215009, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Convolutional neural network; Selective multi-scale network; Feature fusion;
D O I
10.1007/s11760-021-02038-6
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we aim to improve the performance of single-image super-resolution (SISR) by designing a more effective feature extraction module and a better fusion scheme for integrating hierarchical features. Firstly, we propose a selective multi-scale module (SMsM) to adaptively aggregate multi-scale features via self-learned weights and thus extract more distinctive representation. Then, we design an attentive global feature fusion (AGFF) scheme to reduce the redundant information inside the extracted hierarchical features by employing a gate mechanism (in the form of group convolution) and adaptively re-calibrate the features with channel-wise attention weights before fusion. Stacked SMsMs and AGFF compose a novel network which is termed selective multi-scale network (SMsN). Extensive experimental results demonstrate that our SMsN model outperforms some state-of-the-art SISR methods in terms of accuracy and efficiency.
引用
收藏
页码:937 / 945
页数:9
相关论文
共 34 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast and accurate single image super-resolution via an energy-aware improved deep residual network [J].
Cao, Yanpeng ;
He, Zewei ;
Ye, Zhangyu ;
Li, Xin ;
Cao, Yanlong ;
Yang, Jiangxin .
SIGNAL PROCESSING, 2019, 162 :115-125
[3]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[4]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[5]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[6]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[7]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   MRFN: Multi-Receptive-Field Network for Fast and Accurate Single Image Super-Resolution [J].
He, Zewei ;
Cao, Yanpeng ;
Du, Lei ;
Xu, Baobei ;
Yang, Jiangxin ;
Cao, Yanlong ;
Tang, Siliang ;
Zhuang, Yueting .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (04) :1042-1054
[10]   Cascaded Deep Networks With Multiple Receptive Fields for Infrared Image Super-Resolution [J].
He, Zewei ;
Tang, Siliang ;
Yang, Jiangxin ;
Cao, Yanlong ;
Yang, Michael Ying ;
Cao, Yanpeng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (08) :2310-2322