Video Desnower: An Adaptive Feature Fusion Understanding Video Desnowing Model With Deformable Convolution and KNN Point Cloud Transformer

被引:0
作者
Li, Yuxuan [1 ]
Dai, Lin [1 ]
机构
[1] Beijing Inst Technol, Beijing 100081, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; Adaptation models; Nearest neighbor methods; Task analysis; Computational modeling; Deep learning; Computer vision; Videos; Snow; deep learning; video desnowing; feature fusion understanding; NETWORK; REMOVAL;
D O I
10.1109/ACCESS.2024.3432709
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The desnowing (snow removal) model is extensively utilized in various fields, including visual enhancement, security monitoring, and autonomous driving technology. Some previous work developed highly efficient models that primarily addressed single-image desnowing tasks. Simultaneously, the process of video desnowing holds significance in practical applications. There is only a limited amount of literature available on the topic of video desnowing, mainly utilizing predetermined knowledge rather than exploring deep learning technologies. Given the identified deficiency in current research, our study aims to improve upon existing video desnowing methodologies by introducing an innovative approach and filling the void of specialized datasets. Our contribution includes the development of a dataset tailored for the training and assessment of video desnowing models, as well as the creation of the Video-Denower model, which integrates adaptive feature fusion mechanisms. Video-Desnower employs sophisticated adaptive feature fusion methodologies to enhance desnowing efficacy through the comprehensive analysis of features across various scales. In contrast to single-image models, this particular model has the ability to analyze multiple frames within a video. Experiments on a video desnowing dataset show its exceptional capabilities. The code and dataset used in this study are available upon request. Interested researchers can contact us at for access. Please include a brief description of your research interest and how you intend to use the data.
引用
收藏
页码:104354 / 104366
页数:13
相关论文
共 37 条
  • [1] Hyperspectral Image Classification Using Geometric Spatial-Spectral Feature Integration: A Class Incremental Learning Approach
    Bai, Jing
    Liu, Ruotong
    Zhao, Haisheng
    Xiao, Zhu
    Chen, Zheng
    Shi, Wei
    Xiong, Yong
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 15
  • [2] Bass C., 2024, IEEE Trans. Med. Imag., V12
  • [3] ICAM-Reg: Interpretable Classification and Regression With Feature Attribution for Mapping Neurological Phenotypes in Individual Scans
    Bass, Cher
    da Silva, Mariana
    Sudre, Carole
    Williams, Logan Z. J.
    Sousa, Helena S.
    Tudosiu, Petru-Daniel
    Alfaro-Almagro, Fidel
    Fitzgibbon, Sean P.
    Glasser, Matthew F.
    Smith, Stephen M.
    Robinson, Emma C.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (04) : 959 - 970
  • [4] Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks
    Bossu, Jeremie
    Hautiere, Nicolas
    Tarel, Jean-Philippe
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) : 348 - 367
  • [5] Chen SX, 2022, Arxiv, DOI arXiv:2208.09703
  • [6] Chen W. T., Lecture Notes in Computer Science), V12366
  • [7] ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-tree Complex Wavelet Representation and Contradict Channel Loss
    Chen, Wei-Ting
    Fang, Hao-Yu
    Hsieh, Cheng-Lin
    Tsai, Cheng-Che
    Chen, I-Hsiang
    Ding, Jian-Jiun
    Kuo, Sy-Yen
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4176 - 4185
  • [8] Cheng BD, 2022, Arxiv, DOI arXiv:2207.04754
  • [9] Engin D, 2018, Arxiv, DOI arXiv:1805.05308
  • [10] Conservative-Progressive Collaborative Learning for Semi-Supervised Semantic Segmentation
    Fan S.
    Zhu F.
    Feng Z.
    Lv Y.
    Song M.
    Wang F.-Y.
    [J]. IEEE Transactions on Image Processing, 2023, 32 : 6183 - 6194