Multi-scale attention network for image super-resolution

被引:28
作者
Wang, Li [1 ]
Shen, Jie [1 ]
Tang, E. [1 ]
Zheng, Shengnan [1 ,2 ]
Xu, Lizhong [1 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing, Peoples R China
[2] Nanjing Inst Technol, Sch Comp Engn, Nanjing, Peoples R China
关键词
Super-resolution; Multi-scale; Attention mechanism; Lightweight; ACCURATE;
D O I
10.1016/j.jvcir.2021.103300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
ABSTR A C T The power of convolutional neural networks (CNN) has demonstrated irreplaceable advantages in super-resolution. However, many CNN-based methods need large model sizes to achieve superior performance, making them difficult to apply in the practical world with limited memory footprints. To efficiently balance model complexity and performance, we propose a multi-scale attention network (MSAN) by cascading multiple multi-scale attention blocks (MSAB), each of which integrates a multi-scale cross block (MSCB) and a multi-path wide-activated attention block (MWAB). Specifically, MSCB initially connects three parallel convolutions with different dilation rates hierarchically to aggregate the knowledge of features at different levels and scales. Then, MWAB split the channel features from MSCB into three portions to further improve performance. Rather than being treated equally and independently, each portion is responsible for a specific function, enabling internal communication among channels. Experimental results show that our MSAN outperforms most state-of-the-art methods with relatively few parameters and Mult-Adds.
引用
收藏
页数:12
相关论文
共 44 条
[11]  
Hu Y., 2018, BLOCKCHAIN BASED SMA
[12]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[13]   Lightweight Image Super-Resolution with Information Multi-distillation Network [J].
Hui, Zheng ;
Gao, Xinbo ;
Yang, Yunchu ;
Wang, Xiumei .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2024-2032
[14]  
Kim J.-H., 2018, ARXIV181112043
[15]   Accurate Image Super-Resolution Using Very Deep Convolutional Networks [J].
Kim, Jiwon ;
Lee, Jung Kwon ;
Lee, Kyoung Mu .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1646-1654
[16]   MAMNet: Multi-path adaptive modulation network for image super-resolution [J].
Kim, Jun-Hyuk ;
Choi, Jun-Ho ;
Cheon, Manri ;
Lee, Jong-Seok .
NEUROCOMPUTING, 2020, 402 :38-49
[17]   Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5835-5843
[18]   Multi-scale Residual Network for Image Super-Resolution [J].
Li, Juncheng ;
Fang, Faming ;
Mei, Kangfu ;
Zhang, Guixu .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :527-542
[19]  
Li Z., 2019, ARXIV190705282
[20]   Enhanced Deep Residual Networks for Single Image Super-Resolution [J].
Lim, Bee ;
Son, Sanghyun ;
Kim, Heewon ;
Nah, Seungjun ;
Lee, Kyoung Mu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1132-1140