Multi-scale attention network for image super-resolution

被引:28
作者
Wang, Li [1 ]
Shen, Jie [1 ]
Tang, E. [1 ]
Zheng, Shengnan [1 ,2 ]
Xu, Lizhong [1 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing, Peoples R China
[2] Nanjing Inst Technol, Sch Comp Engn, Nanjing, Peoples R China
关键词
Super-resolution; Multi-scale; Attention mechanism; Lightweight; ACCURATE;
D O I
10.1016/j.jvcir.2021.103300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
ABSTR A C T The power of convolutional neural networks (CNN) has demonstrated irreplaceable advantages in super-resolution. However, many CNN-based methods need large model sizes to achieve superior performance, making them difficult to apply in the practical world with limited memory footprints. To efficiently balance model complexity and performance, we propose a multi-scale attention network (MSAN) by cascading multiple multi-scale attention blocks (MSAB), each of which integrates a multi-scale cross block (MSCB) and a multi-path wide-activated attention block (MWAB). Specifically, MSCB initially connects three parallel convolutions with different dilation rates hierarchically to aggregate the knowledge of features at different levels and scales. Then, MWAB split the channel features from MSCB into three portions to further improve performance. Rather than being treated equally and independently, each portion is responsible for a specific function, enabling internal communication among channels. Experimental results show that our MSAN outperforms most state-of-the-art methods with relatively few parameters and Mult-Adds.
引用
收藏
页数:12
相关论文
共 44 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   Densely connected network with improved pyramidal bottleneck residual units for super-resolution [J].
Cao, Feilong ;
Chen, Baijie .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 74
[4]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
[5]   Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search [J].
Chu, Xiangxiang ;
Zhang, Bo ;
Ma, Hailong ;
Xu, Ruijun ;
Li, Qingyuan .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :59-64
[6]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[7]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673
[9]   ODE-inspired Network Design for Single Image Super-Resolution [J].
He, Xiangyu ;
Mo, Zitao ;
Wang, Peisong ;
Liu, Yang ;
Yang, Mingyuan ;
Cheng, Jian .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1732-1741
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]