Lightweight super resolution method based on blueprint separable convolution for mine image

被引:0
作者
Kou, Qiqi [1 ]
Cheng, Zhiwei [2 ]
Cheng, Deqiang [2 ]
Chen, Jie [2 ]
Zhang, Jianying [2 ]
机构
[1] School of Computer Science and Technology, China University of Mining and Technology, Xuzhou
[2] School of Information and Control Engineering, China University of Mining and Technology, Xuzhou
来源
Meitan Xuebao/Journal of the China Coal Society | 2024年 / 49卷 / 09期
关键词
attention mechanism; feature fusions; lightweight; mine image; super-resolution reconstruction;
D O I
10.13225/j.cnki.jccs.2023.1101
中图分类号
学科分类号
摘要
In the complex confined space of underground coal mine, some environmental factors such as uneven illumination of artificial light source, heavy concentration of dust and fog in the working face, and complex electromagnetic interference can seriously affect the high-definition imaging of underground surveillance video. Aiming at the problems of low resolution and blurring of mine images affected by complex environment, and the problems that the current image super-resolution reconstruction methods mostly improve the reconstruction effect at the expense of compromising network depth and width, which will increase the complexity of the algorithm greatly, as well as the memory usage of the network model, making it difficult to apply to actual edge mobile devices. In this study, a lightweight super-resolution reconstruction method of mine images based on blueprint separation convolution is proposed. Firstly, the high-efficiency blueprint separation convolution is used to replace the standard convolution in the residual block, and a lightweight residual attention module is designed by introducing coordinate attention mechanism and adding skip connections to improve the residual block, so that the model can achieve a better feature extraction ability while keeping low parameters and computation. Secondly, an enhanced hierarchical feature fusion module is designed to integrate local features first and then global features of different hierarchical features in the network, which can further promote the information flow in the network and enhance the feature utilization rate of the model. Finally, the pixel attention mechanism is added at the end of the network to enhance the attention of the network to the information features, which can improve the feature expression ability of the model and provide more detailed features for the image reconstruction module. Experimental results show that the image quality reconstructed by the lightweight super-resolution reconstruction network based on blueprint separation convolution is not only superior to other comparison algorithms in terms of objective indexes and visual perception, but also achieves a better trade-off between model performance and complexity. When the scaling factor is 4, in comparison to the lightweight algorithm AWSRN-M with the same number of parameters, the average PSNR and SSIM on the coal mine test set are increased by 0.177 2 dB and 0.010 7 respectively, and the floating-point computation is reduced by 66.9%. The results demonstrate that the proposed method can effectively extract the detailed feature information with different levels, achieve the deep fusion of shallow and deep features, and more efficiently reconstruct high-resolution images with clear texture details. © 2024 China Coal Society. All rights reserved.
引用
收藏
页码:4038 / 4050
页数:12
相关论文
共 32 条
[1]  
XIE Heping, ZHANG Jixiong, GAO Feng, Et al., Theory and technical conception of carbon-negative and high-efficient backfill mining in coal mines[J], Journal of China Coal Society, 49, 1, pp. 36-46, (2024)
[2]  
CHENG Deqiang, QIAN Jiansheng, GUO Xingge, Et al., Review on key technologies of AI recognition for videos in coal mine[J], Coal Science and Technology, 51, 2, pp. 349-365, (2023)
[3]  
YUAN Liang, ZHANG Pingsong, Key technology and path thinking of dynamic reconstruction of mine transparent geological model[J], Journal of China Coal Society, 48, 1, pp. 1-14, (2023)
[4]  
CHENG D, CHEN L, LV C, Et al., Light-Guided and Cross-Fusion U-Net for Anti-Illumination Image Super-Resolution[J], IEEE Transactions on Circuits and Systems for Video Technology, 32, 12, (2022)
[5]  
KOU Qiqi, Chao LI, CHENG Deqiang, Et al., Image super-resolution reconstruction based on attention and wide-activated dense residual network[J], Optics and Precision Engineering, 31, 15, pp. 2273-2286, (2023)
[6]  
CHANG H, YEUNG D-Y, XIONG Y., Super-resolution through neighbor embedding, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (2004)
[7]  
YANG J, WRIGHT J, HUANG T S, Et al., Image super-resolution via sparse representation[J], IEEE Transactions on Image Processing, 19, 11, (2010)
[8]  
CHEN L, GUO L, CHENG D, Et al., Structure-preserving and color-restoring up-sampling for single low-light image[J], IEEE Transactions on Circuits and Systems for Video Technology, 32, 4, (2022)
[9]  
DONG C, LOY C C, HE K, Et al., Learning a deep convolutional network for image super-resolution[C], Proceedings of the European Conference on Computer Vision(ECCV), pp. 184-199, (2014)
[10]  
DONG C, LOY C C, TANG X., Accelerating the super-resolution convolutional neural network[C], Proceedings of the European Conference on Computer Vision (ECCV), pp. 391-407, (2016)