Single image super-resolution based on multi-scale dense attention network

被引:8
作者
Gao, Farong [1 ]
Wang, Yong [1 ]
Yang, Zhangyi [1 ]
Ma, Yuliang [1 ]
Zhang, Qizhong [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Inst Intelligent Control & Robot, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Multi-scale convolution; Attention mechanism; Feature fusion;
D O I
10.1007/s00500-022-07456-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks (CNNs) have enabled significant progress in the single image super-resolution (SISR) field in recent years. However, most super-resolution methods based on deep neural networks obtain spatial information using a single-size convolution kernel, which leads to insufficient local feature extraction. In addition, since convolution serves for local operations, it fails to capture the image's inherent attributes. This paper tackles these problems by proposing a novel multi-scale dense attention network (MSDAN) based on the attention mechanism and multi-scale feature extraction. The network employs multi-scale dense blocks (MSDB) that utilize convolution kernels of different sizes to extract feature information of distinct scales. Additionally, the attention is used to model global features effectively and strengthen the network's expressiveness. Hierarchical feature fusion is followed by multi-level feature extraction, which fuses each unit's feature map output. Finally, the image is reconstructed using up-sampling. The experimental results show that the proposed network outperforms other several state-of-the-art super-resolution reconstruction algorithms regarding objective evaluation indicators and visual effects on datasets Set5, Set14, BSD100 and Urban100.
引用
收藏
页码:2981 / 2992
页数:12
相关论文
共 39 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   Contour Detection and Hierarchical Image Segmentation [J].
Arbelaez, Pablo ;
Maire, Michael ;
Fowlkes, Charless ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) :898-916
[3]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   Improvement of Image Super-resolution Algorithms using Iterative Back Projection [J].
Blanco Castro E. ;
Nakano M. ;
Sanchez Perez G. ;
Perez Meana H. .
2017, IEEE Computer Society (15) :2214-2219
[6]   Super-resolution using multi-channel merged convolutional network [J].
Chu, Jinghui ;
Li, Xiaochuan ;
Zhang, Jiaqi ;
Lu, Wei .
NEUROCOMPUTING, 2020, 394 (394) :136-145
[7]   Density Peaks Clustering by Zero-Pointed Samples of Regional Group Borders [J].
Ding, Lin ;
Xu, Weihong ;
Chen, Yuantao .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020 (2020)
[8]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[9]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[10]  
Emami H, 2019, ARXIV