ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-tree Complex Wavelet Representation and Contradict Channel Loss

被引:103
作者
Chen, Wei-Ting [1 ,3 ]
Fang, Hao-Yu [2 ]
Hsieh, Cheng-Lin [1 ]
Tsai, Cheng-Che [1 ]
Chen, I-Hsiang [2 ]
Ding, Jian-Jiun [2 ]
Kuo, Sy-Yen [2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Elect Engn, Taipei, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
[3] ASUS Intelligent Cloud Serv, Taipei, Taiwan
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
D O I
10.1109/ICCV48922.2021.00416
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Snow is a highly complicated atmospheric phenomenon that usually contains snowflake, snow streak, and veiling effect (similar to the haze or the mist). In this literature, we propose a single image desnowing algorithm to address the diversity of snow particles in shape and size. First, to better represent the complex snow shape, we apply the dual-tree wavelet transform and propose a complex wavelet loss in the network. Second, we propose a hierarchical decomposition paradigm in our network for better understanding the different sizes of snow particles. Last, we propose a novel feature called the contradict channel (CC) for the snow scenes. We find that the regions containing the snow particles tend to have higher intensity in the CC than that in the snow-free regions. We leverage this discriminative feature to construct the contradict channel loss for improving the performance of snow removal. Moreover, due to the limitation of existing snow datasets, to simulate the snow scenarios comprehensively, we propose a large-scale dataset called Comprehensive Snow Dataset (CSD). Experimental results show that the proposed method can favorably outperform existing methods in three synthetic datasets and real-world datasets.
引用
收藏
页码:4176 / 4185
页数:10
相关论文
共 43 条
  • [1] Efficient Registration of Nonrigid 3-D Bodies
    Chen, Huizhong
    Kingsbury, Nick
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (01) : 262 - 272
  • [2] PMHLD: Patch Map-Based Hybrid Learning DehazeNet for Single Image Haze Removal
    Chen, Wei-Ting
    Fang, Hao-Yu
    Ding, Jian-Jiun
    Kuo, Sy-Yen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6773 - 6788
  • [3] PMS-Net: Robust Haze Removal Based on Patch Map for Single Images
    Chen, Wei-Ting
    Ding, Jian-Jiun
    Kuo, Sy-Yen
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11673 - 11681
  • [4] MLL-AF9 initiates transformation from fast-proliferating myeloid progenitors (vol 10, 5767, 2019)
    Chen, Xinyue
    Burkhardt, Daniel B.
    Hartman, Amaleah A.
    Hu, Xiao
    Eastman, Anna E.
    Sun, Chao
    Wang, Xujun
    Zhong, Mei
    Krishnaswamy, Smita
    Guo, Shangqin
    [J]. NATURE COMMUNICATIONS, 2020, 11 (01)
  • [5] Restoring An Image Taken Through a Window Covered with Dirt or Rain
    Eigen, David
    Krishnan, Dilip
    Fergus, Rob
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 633 - 640
  • [6] Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing
    Engin, Deniz
    Genc, Anil
    Ekenel, Hazim Kemal
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 938 - 946
  • [7] Res2Net: A New Multi-Scale Backbone Architecture
    Gao, Shang-Hua
    Cheng, Ming-Ming
    Zhao, Kai
    Zhang, Xin-Yu
    Yang, Ming-Hsuan
    Torr, Philip
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) : 652 - 662
  • [8] A New Partial Discharge Signal Denoising Algorithm Based on Adaptive Dual-Tree Complex Wavelet Transform
    Ghorat, Mohsen
    Gharehpetian, G. B.
    Latifi, Hamid
    Hejazi, Maryam A.
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (10) : 2262 - 2272
  • [9] Single Image Haze Removal Using Dark Channel Prior
    He, Kaiming
    Sun, Jian
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) : 2341 - 2353
  • [10] Jia Y, 2018, INT CONF SPEECH DATA, P49