MESR: Multistage Enhancement Network for Image Super-Resolution

被引:1
作者
Huang, Detian [1 ]
Chen, Jian [1 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
关键词
Feature extraction; Image reconstruction; Superresolution; Training; Task analysis; Learning systems; Kernel; Image super-resolution; multi-stage network; multi-scale feature; feature fusion; image refinement; ATTENTION NETWORK; RESOLUTION FRAMES;
D O I
10.1109/ACCESS.2022.3176605
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, the deep-learning-based image super-resolution methods have achieved astounding advancement. Whereas most of these methods utilize features from the low-resolution image space exclusively, and ignore the dependency between contextual features simultaneously, resulting in their limited ability to restore details. To this end, a multi-stage enhancement image network for super-resolution (MESR) is proposed. The network consists of two stages, where the first stage is used to generate a coarse reconstructed image, and the second one is to refine the coarse image, which enhances the super-resolution performance. Specifically, in the first stage, to acquire more abundant features, an effective funnel-like multi-scale feature extractor is proposed, incorporating a channel attention mechanism to boost the feature representation capability. Moreover, an adaptive weighted residual feature fusion block is designed to effectively explore and exploit the dependency between contextual features for generating more beneficial features. In the second stage, a refinement block is proposed to additionally strengthen the details of the reconstructed image by exploring the feature information from the high-resolution image space. Experimental results demonstrate that the proposed method achieves superior performance against the state-of-the-art SR methods in terms of both subjective visual quality and objective quantitative metrics.
引用
收藏
页码:54599 / 54612
页数:14
相关论文
共 82 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]   Single Image Super-Resolution via a Holistic Attention Network [J].
Niu, Ben ;
Wen, Weilei ;
Ren, Wenqi ;
Zhang, Xiangde ;
Yang, Lianping ;
Wang, Shuzhen ;
Zhang, Kaihao ;
Cao, Xiaochun ;
Shen, Haifeng .
COMPUTER VISION - ECCV 2020, PT XII, 2020, 12357 :191-207
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[6]   HINet: Half Instance Normalization Network for Image Restoration [J].
Chen, Liangyu ;
Lu, Xin ;
Zhang, Jie ;
Chu, Xiaojie ;
Chen, Chengpeng .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :182-192
[7]   Super-Resolution Enhanced Medical Image Diagnosis With Sample Affinity Interaction [J].
Chen, Zhen ;
Guo, Xiaoqing ;
Woo, Peter Y. M. ;
Yuan, Yixuan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (05) :1377-1389
[8]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[9]  
Dai SY, 2007, PROC CVPR IEEE, P445
[10]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066