An integrated multi-scale context-aware network for efficient desnowing

被引:1
作者
Agyemang, Samuel Akwasi [1 ]
Shi, Haobin [1 ]
Nie, Xuan [1 ]
Asabere, Nana Yaw [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Shaanxi, Peoples R China
[2] Accra Tech Univ, Comp Sci Dept, Accra, Ghana
关键词
Snow removal; Multi-scale features; Vision transformer; Attention mechanism; REMOVING SNOW;
D O I
10.1016/j.engappai.2025.110769
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Adverse snow conditions, significantly degrade visual data quality, resulting in substantial performance drops in computer vision systems. We propose an advanced neural network architecture designed for desnowing tasks, leveraging multi-scale features and context-aware attention mechanisms. Our novel network integrates a series of enhancements including ghost encoders for efficient feature representation and extraction through the utilization of linear transformations, and the multi-scale transformer bottleneck which combines the atrous spatial pyramid pooling with a vision transformer in the bottleneck to strengthen multi-scale feature extraction and captures local and global dependencies. Additionally, the SimGC attention module combines the simple parameter-free attention and global context attention, to enhance local and global spatial features. Lastly, the feature enhancement module is used to refine the final reconstruction. Our experimental results demonstrate that the proposed network significantly outperforms state-of-the-art methods on certain metrics and confirms the robustness and accuracy of our approach.
引用
收藏
页数:10
相关论文
共 33 条
[1]   Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks [J].
Bossu, Jeremie ;
Hautiere, Nicolas ;
Tarel, Jean-Philippe .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :348-367
[2]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[3]  
Chen W.-T., 2020, Computer Vision-ECCV 2020
[4]   Learning Multiple Adverse Weather Removal via Two-stage Knowledge Learning and Multi-contrastive Regularization: Toward a Unified Model [J].
Chen, Wei-Ting ;
Huang, Zhi-Kai ;
Tsai, Cheng-Che ;
Yang, Hao-Hsiang ;
Ding, Jian-Jiun ;
Kuo, Sy-Yen .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17632-17641
[5]   ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-tree Complex Wavelet Representation and Contradict Channel Loss [J].
Chen, Wei-Ting ;
Fang, Hao-Yu ;
Hsieh, Cheng-Lin ;
Tsai, Cheng-Che ;
Chen, I-Hsiang ;
Ding, Jian-Jiun ;
Kuo, Sy-Yen .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4176-4185
[6]   Snow Mask Guided Adaptive Residual Network for Image Snow Removal [J].
Cheng, Bodong ;
Li, Juncheng ;
Chen, Ying ;
Zeng, Tieyong .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 236
[7]   Context-aware coarse-to-fine network for single image desnowing [J].
Cheng, Yunrui ;
Ren, Hao ;
Zhang, Rui ;
Lu, Hong .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) :55903-55920
[8]   Global Context Attention for Robust Visual Tracking [J].
Choi, Janghoon .
SENSORS, 2023, 23 (05)
[9]  
Cui YN, 2024, IEEE T PATTERN ANAL, V46, P9423, DOI [10.1109/tvt.2024.3377630, 10.1109/TPAMI.2024.3419007]
[10]  
Dosovitskiy Alexey., 2021, PROC INT C LEARN REP, P2021, DOI [DOI 10.48550/ARXIV.2010.11929, 10.48550/arXiv.2010.11929]