ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-tree Complex Wavelet Representation and Contradict Channel Loss

被引:103
作者
Chen, Wei-Ting [1 ,3 ]
Fang, Hao-Yu [2 ]
Hsieh, Cheng-Lin [1 ]
Tsai, Cheng-Che [1 ]
Chen, I-Hsiang [2 ]
Ding, Jian-Jiun [2 ]
Kuo, Sy-Yen [2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Elect Engn, Taipei, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
[3] ASUS Intelligent Cloud Serv, Taipei, Taiwan
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
D O I
10.1109/ICCV48922.2021.00416
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Snow is a highly complicated atmospheric phenomenon that usually contains snowflake, snow streak, and veiling effect (similar to the haze or the mist). In this literature, we propose a single image desnowing algorithm to address the diversity of snow particles in shape and size. First, to better represent the complex snow shape, we apply the dual-tree wavelet transform and propose a complex wavelet loss in the network. Second, we propose a hierarchical decomposition paradigm in our network for better understanding the different sizes of snow particles. Last, we propose a novel feature called the contradict channel (CC) for the snow scenes. We find that the regions containing the snow particles tend to have higher intensity in the CC than that in the snow-free regions. We leverage this discriminative feature to construct the contradict channel loss for improving the performance of snow removal. Moreover, due to the limitation of existing snow datasets, to simulate the snow scenarios comprehensively, we propose a large-scale dataset called Comprehensive Snow Dataset (CSD). Experimental results show that the proposed method can favorably outperform existing methods in three synthetic datasets and real-world datasets.
引用
收藏
页码:4176 / 4185
页数:10
相关论文
共 43 条
  • [21] A Dual-Tree Complex Wavelet Transform based Convolutional Neural Network for Human Thyroid Medical Image Segmentation
    Lu, Hongya
    Wang, Haifeng
    Zhang, Qianqian
    Won, Daehan
    Yoon, Sang Won
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2018, : 191 - 198
  • [22] CT Image Denoising Using Double Density Dual Tree Complex Wavelet with Modified Thresholding
    Luo, Peng
    Qu, Xilong
    Qing, Xie
    Gu, Jinjie
    [J]. 2ND INTERNATIONAL CONFERENCE ON DATA SCIENCE AND BUSINESS ANALYTICS (ICDSBA 2018), 2018, : 287 - 290
  • [23] Large Kernel Matters - Improve Semantic Segmentation by Global Convolutional Network
    Peng, Chao
    Zhang, Xiangyu
    Yu, Gang
    Luo, Guiming
    Sun, Jian
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1743 - 1751
  • [24] Effect of periodic wakes and a contoured endwall on secondary flow in a high-lift low-pressure turbine cascade at low Reynolds numbers
    Qu, Xiao
    Zhang, Yanfeng
    Lu, Xingen
    Lei, Zhijun
    Zhu, Junqiang
    [J]. COMPUTERS & FLUIDS, 2019, 190 : 1 - 14
  • [25] Single Image Dehazing via Multi-scale Convolutional Neural Networks
    Ren, Wenqi
    Liu, Si
    Zhang, Hua
    Pan, Jinshan
    Cao, Xiaochun
    Yang, Ming-Hsuan
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 154 - 169
  • [26] Ricci E, 2017, COMPUT VIS PATT REC, P67, DOI 10.1016/B978-0-12-809276-7.00005-9
  • [27] The dual-tree complex wavelet transform
    Selesnick, IW
    Baraniuk, RG
    Kingsbury, NG
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2005, 22 (06) : 123 - 151
  • [28] Algorithm for image stitching in the infrared
    Semenishchev, Evgenii
    Voronin, Viacheslav
    Zelensky, Aleksandr
    Shraifel, Igor
    [J]. INFRARED TECHNOLOGY AND APPLICATIONS XLV, 2019, 11002
  • [29] Domain Adaptation for Image Dehazing
    Shao, Yuanjie
    Li, Lerenhan
    Ren, Wenqi
    Gao, Changxin
    Sang, Nong
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2805 - 2814
  • [30] Efficient Convolutional Network Learning using Parametric Log based Dual-Tree Wavelet ScatterNet
    Singh, Amarjot
    Kingsbury, Nick
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 1140 - 1147