Attention mechanism feedback network for image super-resolution

被引:8
作者
Chen, Xiao [1 ,2 ]
Jing, Ruyun [1 ]
Suna, Chaowen [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing, Peoples R China
关键词
image super-resolution; separable convolution; upper and lower projection units; attention mechanism; feedback network; FRACTIONAL DERIVATIVE METHOD; RATE CONTROL ALGORITHM; LAMB WAVE SIGNALS; NOISE;
D O I
10.1117/1.JEI.31.4.043006
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The number of photosensitive elements in the image sensor determines the resolution of the original image. One promising method for increasing the resolution of an image without increasing hardware cost is image super-resolution. Many existing image super-resolution methods based on deep learning lack feedback mechanisms and deal with feature channels equally, which hinders the expressive ability of deep learning networks and makes it difficult to resolve the dependence between high- and low-resolution (LR) images. An image super-resolution method based on an attention mechanism feedback network was presented in this study. First, the proposed multiscale separable convolution layer is used to extract the characteristics of the input image. Second, a feedback module is designed to process the feedback connections between subnetworks and generate richer high-level representations through densely connected upper and lower projection units, enabling the recovery of high-resolution (HR) images from LR images. Subsequently, an attention mechanism is introduced in the feedback module to redistribute channel attention resources, enhance interdependence between channels, and focus the network on learning high-frequency information. Finally, the reconstructed image was gradually generated using the reconstruction layer through an iterative network. The experimental results for x2 to x8 image super-resolution on five standard datasets showed that the quality of the reconstructed image of the proposed method outperforms that of the comparative image super-resolution methods in terms of subjective perception and objective evaluation indices. It can retain more detail for super-resolution and obtain better HR images.
引用
收藏
页数:17
相关论文
共 58 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Developing and using fast shear wave elastography to quantify physiologically-relevant tendon forces [J].
Ahmadzadeh, S. M. Hassan ;
Chen, Xiao ;
Hagemann, Henrik ;
Tang, Meng-Xing ;
Bull, Anthony M. J. .
MEDICAL ENGINEERING & PHYSICS, 2019, 69 :116-122
[3]  
Ai W., 2020, P IEEE INT C IM PROC, P1586
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]  
[曹仰杰 Cao Yangjie], 2018, [中国图象图形学报, Journal of Image and Graphics], V23, P1433
[6]   Human Pose Estimation with Iterative Error Feedback [J].
Carreira, Joao ;
Agrawal, Pulkit ;
Fragkiadaki, Katerina ;
Malik, Jitendra .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4733-4742
[7]  
Chen J L, 2021, Application Research, V38, P2235
[8]   Land scene classification for remote sensing images with an improved capsule network [J].
Chen, Xiao ;
Zhu, Juan .
JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (02)
[9]   Multiscale Recursive Feedback Network for Image Super-Resolution [J].
Chen, Xiao ;
Sun, Chaowen .
IEEE ACCESS, 2022, 10 :6393-6406
[10]   Effect of Transducer Shadowing of Ultrasonic Anemometers on Wind Velocity Measurement [J].
Chen, Xiao ;
Zhan, Wei .
IEEE SENSORS JOURNAL, 2021, 21 (04) :4731-4738