A Two-Stage Three-Dimensional Attention Network for Lightweight Image Super-Resolution

被引:1
作者
Chen, Lei [1 ,2 ]
Yang, Yanjie [1 ]
Zhuang, Xu [2 ]
Wang, Jason [2 ]
Mao, Qin [3 ,4 ]
Yue, Hong [5 ]
Wei, Xuekai [1 ]
Cheng, Fei [6 ]
Zong, Xuemei [7 ]
Zhou, Mingliang [1 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] OPPO Inc, Chengdu 610000, Peoples R China
[3] Qiannan Normal Univ Nationalities, Sch Comp & Informat Technol, Duyun 558000, Peoples R China
[4] Key Lab Complex Syst & Intelligent Optimizat Guizh, Duyun 558000, Peoples R China
[5] CICT Connected & Intelligent Technol Co Ltd, Chongqing 400044, Peoples R China
[6] Xian Jiaotong Liverpool Univ, Sch Adv Technol, Suzhou 215000, Peoples R China
[7] Jiangsu XCMG Construct Machinery Res Institude Ltd, Xuzhou 221000, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; lightweight; low-resolution stage; high-resolution stage; attention mechanism;
D O I
10.1142/S0218001423540174
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, single image super-resolution (SISR) methods using convolutional neural networks (CNN) have achieved satisfactory performance. Nevertheless, the large model scale and the slow inference speed of these methods greatly limit the application scenarios. In this paper, we propose a two-stage three-dimensional attention network (ATTNet) for lightweight image super-resolution. First, we put forward the spatial feature encoder-decoder (SFE-D) with a spatial attention mechanism. Next, the channel transposed attention module (CTAM) with a channel self-attention mechanism is designed. Both the modules are used for fine feature extraction in the low-resolution stage. Finally, the content-based pixel recombination module (CPRM) is proposed to reconstruct the detailed content with a joint attention mechanism in the high-resolution stage. According to our experimental results, significant performance in terms of the quantitative metrics and the subjective visual quality can be achieved on average compared with the state-of-the-art lightweight SISR algorithms.
引用
收藏
页数:19
相关论文
共 46 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]  
Bengio, 2018, ADV NEURAL INFORM PR, V31, P352
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   Multi-Attention Residual Network for Image Super Resolution [J].
Chang, Qing ;
Jia, Xiaotian ;
Lu, Chenhao ;
Ye, Jian .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (08)
[5]  
Chen YP, 2018, ADV NEUR IN, V31
[6]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[7]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]  
Hu J, 2018, ADV NEUR IN, V31
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]