Residual Triplet Attention Network for Single-Image Super-Resolution

被引:3
作者
Huang, Feng [1 ]
Wang, Zhifeng [1 ]
Wu, Jing [1 ]
Shen, Ying [1 ]
Chen, Liqiong [1 ]
机构
[1] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
基金
中国国家自然科学基金;
关键词
image super-resolution; attention mechanism; convolutional neural networks; deep learning;
D O I
10.3390/electronics10172072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-image super-resolution (SISR) techniques have been developed rapidly with the remarkable progress of convolutional neural networks (CNNs). The previous CNNs-based SISR techniques mainly focus on the network design while ignoring the interactions and interdependencies between different dimensions of the features in the middle layers, consequently hindering the powerful learning ability of CNNs. In order to address this problem effectively, a residual triplet attention network (RTAN) for efficient interactions of the feature information is proposed. Specifically, we develop an innovative multiple-nested residual group (MNRG) structure to improve the learning ability for extracting the high-frequency information and train a deeper and more stable network. Furthermore, we present a novel lightweight residual triplet attention module (RTAM) to obtain the cross-dimensional attention weights of the features. The RTAM combines two cross-dimensional interaction blocks (CDIBs) and one spatial attention block (SAB) base on the residual module. Therefore, the RTAM is not only capable of capturing the cross-dimensional interactions and interdependencies of the features, but also utilizing the spatial information of the features. The simulation results and analysis show the superiority of the proposed RTAN over the state-of-the-art SISR networks in terms of both evaluation metrics and visual results.
引用
收藏
页数:21
相关论文
共 78 条
[1]   Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition [J].
Adjabi, Insaf ;
Ouahabi, Abdeldjalil ;
Benzaoui, Amir ;
Jacques, Sebastien .
SENSORS, 2021, 21 (03) :1-21
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Model [J].
Cai, Jianrui ;
Zeng, Hui ;
Yong, Hongwei ;
Cao, Zisheng ;
Zhang, Lei .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3086-3095
[5]   New architecture of deep recursive convolution networks for super-resolution [J].
Cao, Feilong ;
Chen, Baijie .
KNOWLEDGE-BASED SYSTEMS, 2019, 178 :98-110
[6]  
Chen Haoyu, 2021, ARXIV210409497
[7]  
Chu Xiangxiang, 2019, ARXIV190107261
[8]   Multi-Context Attention for Human Pose Estimation [J].
Chu, Xiao ;
Yang, Wei ;
Ouyang, Wanli ;
Ma, Cheng ;
Yuille, Alan L. ;
Wang, Xiaogang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5669-5678
[9]  
Dai T, 2019, P IEEECVF C COMPUTER
[10]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407