Image super-resolution reconstruction network based on expectation maximization self-attention residual

被引:0
作者
Huang S. [1 ]
Hu H. [2 ]
Yang Y. [3 ]
Wan W. [4 ]
Wu Z. [2 ]
机构
[1] School of Software, Tiangong University, Tianjin
[2] School of Information Management, Jiangxi University of Finance and Economics, Nanchang
[3] School of Computer Science and Technology, Tiangong University, Tianjin
[4] School of Software and Internet of Things Engineering, Jiangxi University of Finance and Economics, Nanchang
来源
Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics | 2024年 / 50卷 / 02期
基金
中国国家自然科学基金;
关键词
attention mechanism; EM self-attention residual block; expectation maximization; feature-enhanced residual block; super-resolution reconstruction;
D O I
10.13700/j.bh.1001-5965.2022.0401
中图分类号
学科分类号
摘要
In recent years, most deep learning-based image super-resolution (SR) reconstruction methods mainly improve the quality of image reconstruction by increasing the depth of the model, while also increasing the computational cost of the model. Additionally, a lot of networks have implemented the attention mechanism to enhance their capacity for feature extraction, but it is still challenging to properly understand the properties of various regions. In response to the above problems, this paper proposes a novel SR reconstruction network based on expectation maximization (EM) self-attention residual. The network constructs a feature-enhanced residual block by improving the basic residual block to better reuse the features extracted from the residual block. In order to increase the spatial correlation of the feature information, an EM self-attention residual block is constructed by introducing the EM self-attention mechanism, which is used to enhance the feature extraction capability of each module in the deep network model. Moreover, the feature extraction structure of the entire model is constructed by cascading EM self-attention residual blocks. Finally, a reconstructed high-resolution image is obtained through an up-sampling image reconstruction module.In order to verify the effectiveness of the proposed method, this paper has carried out comparison experiments with some mainstream methods. The experimental results show that the proposed method can achieve better subjective visual effects and better objective evaluation indicators on five popular widely used SR test datasets. © 2024 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:388 / 397
页数:9
相关论文
共 41 条
[1]  
TAKEDA H, MILANFAR P, PROTTER M, Et al., Super-resolution without explicit subpixel motion estimation, IEEE Transactions on Image Processing, 18, 9, pp. 1958-1975, (2009)
[2]  
ZOU W W W, YUEN P C., Very low resolution face recognition problem, IEEE Transactions on Image Processing, 21, 1, pp. 327-340, (2012)
[3]  
SHI W, CABALLERO J, LEDIG C, Et al., Cardiac image super-resolution with global correspondence using multi-atlas PatchMatch, Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, 8151, pp. 9-16, (2013)
[4]  
ARUN P V, BUDDHIRAJU K M, PORWAL A, Et al., CNN based spectral super-resolution of remote sensing images, Signal Processing, 169, (2020)
[5]  
KEYS R., Cubic convolution interpolation for digital image processing, IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 6, pp. 1153-1160, (1981)
[6]  
MARQUIAN A, OSHER S J., Image super-resolution by TV-regularization and Bregman iteration, Journal of Scientific Computing, 37, 3, pp. 367-382, (2008)
[7]  
DONG W, ZHANG L, SHI G, Et al., Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization, IEEE Transactions on Image Processing, 20, 7, pp. 1838-1857, (2011)
[8]  
YANG J, WRIGHT J, HUANG T S, Et al., Image super-resolution via sparse representation, IEEE Transactions on Image Processing, 19, 11, pp. 2861-2873, (2010)
[9]  
ZEYDE R, ELAD M, PROTTER M., On single image scale-up using sparse-representations, Proceedings of the International Conference on Curves and Surfaces, pp. 711-730, (2010)
[10]  
HU Y, WANG N, TAO D, Et al., SERF: A simple, effective, robust, and fast image super-resolver from cascaded linear regression, IEEE Transactions on Image Processing, 25, 9, pp. 4091-4102, (2016)