Context-aware coarse-to-fine network for single image desnowing

被引:0
作者
Yunrui Cheng
Hao Ren
Rui Zhang
Hong Lu
机构
[1] School of Computer Science,Shanghai Key Lab of Intelligent Information Processing
[2] Fudan University,undefined
来源
Multimedia Tools and Applications | 2024年 / 83卷
关键词
Image desnowing; Coarse-to-fine; Context interaction; Contrastive learning;
D O I
暂无
中图分类号
学科分类号
摘要
Image desnowing is a challenging task in computer vision, as it requires the removal of snow from images while preserving the underlying scene structure and content. In order to achieve high performance, desnowing methods need to be able to effectively capture both local and global information in the image. The proposed method addresses this challenge by introducing a novel Context-aware Feature Aggregation (CFA) module. The CFA module is designed to capture both local and global information by aggregating features of the network in latent space. This allows the method to better understand the contextual relationships in the image, which is essential for accurate snow removal. In addition to the CFA module, the proposed method also introduces a Selective Refinement Head (SRH). The SRH is designed to adaptively fuse coarse features from the encoder and decoder of the network. This allows the method to refine the output by incorporating relevant information from both low-level and high-level representations. Finally, the proposed method leverages the capabilities of contrastive learning to better align the desnow images and ground-truth images in perceptual space. This leads to improved image quality and desnowing performance. Extensive experiments on both synthetic and real-world datasets show that the proposed method achieves state-of-the-art results on image desnowing task.
引用
收藏
页码:55903 / 55920
页数:17
相关论文
共 51 条
  • [1] Ding X(2016)Single image rain and snow removal via guided l0 smoothing filter Multimed Tool Appl 75 2697-2712
  • [2] Chen L(2022)Single image rain/snow removal using distortion type information Multimed Tools Appl 81 14105-14131
  • [3] Zheng X(2020)Hierarchical deep cnn feature set-based representation learning for robust cross-resolution face recognition IEEE Trans Circuit Syst Video Technol 32 2550-2560
  • [4] Fazlali H(2020)Desnowgan: an efficient single image snow removal framework using cross-resolution lateral connection and gans IEEE Trans Circuit Syst Video Technol 31 1342-1350
  • [5] Shirani S(2019)Single image snow removal via composition generative adversarial networks IEEE Access 7 25016-25025
  • [6] Bradford M(2018)Desnownet: context-aware deep network for snow removal IEEE Trans Image Process 27 3064-3073
  • [7] Gao G(2022)Depth-guided asymmetric cyclegan for rain synthesis and image deraining Multimed Tool Appl 81 35935-35952
  • [8] Yu Y(2021)High-resolution image de-raining using conditional gan with sub-pixel upscaling Multimed Tool Appl 80 1075-1094
  • [9] Yang J(2017)Rain streak removal by multi-frame-based anisotropic filtering Multimed Tool Appl 76 2019-2038
  • [10] Jaw DW(2020)Densely connected multi-scale de-raining net Multimed Tool Appl 79 19595-19614