ALL Snow Removed: Single Image Desnowing Algorithm Using Hierarchical Dual-tree Complex Wavelet Representation and Contradict Channel Loss

被引:142
作者
Chen, Wei-Ting [1 ,3 ]
Fang, Hao-Yu [2 ]
Hsieh, Cheng-Lin [1 ]
Tsai, Cheng-Che [1 ]
Chen, I-Hsiang [2 ]
Ding, Jian-Jiun [2 ]
Kuo, Sy-Yen [2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Elect Engn, Taipei, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
[3] ASUS Intelligent Cloud Serv, Taipei, Taiwan
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
D O I
10.1109/ICCV48922.2021.00416
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Snow is a highly complicated atmospheric phenomenon that usually contains snowflake, snow streak, and veiling effect (similar to the haze or the mist). In this literature, we propose a single image desnowing algorithm to address the diversity of snow particles in shape and size. First, to better represent the complex snow shape, we apply the dual-tree wavelet transform and propose a complex wavelet loss in the network. Second, we propose a hierarchical decomposition paradigm in our network for better understanding the different sizes of snow particles. Last, we propose a novel feature called the contradict channel (CC) for the snow scenes. We find that the regions containing the snow particles tend to have higher intensity in the CC than that in the snow-free regions. We leverage this discriminative feature to construct the contradict channel loss for improving the performance of snow removal. Moreover, due to the limitation of existing snow datasets, to simulate the snow scenarios comprehensively, we propose a large-scale dataset called Comprehensive Snow Dataset (CSD). Experimental results show that the proposed method can favorably outperform existing methods in three synthetic datasets and real-world datasets.
引用
收藏
页码:4176 / 4185
页数:10
相关论文
共 43 条
[21]   Enhancing Energy-Efficient and QoS Dynamic Virtual Machine Consolidation Method in Cloud Environment [J].
Liu, Yaqiu ;
Sun, Xinyue ;
Wei, Wei ;
Jing, Weipeng .
IEEE ACCESS, 2018, 6 :31224-31235
[22]   A Dual-Tree Complex Wavelet Transform based Convolutional Neural Network for Human Thyroid Medical Image Segmentation [J].
Lu, Hongya ;
Wang, Haifeng ;
Zhang, Qianqian ;
Won, Daehan ;
Yoon, Sang Won .
2018 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2018, :191-198
[23]   CT Image Denoising Using Double Density Dual Tree Complex Wavelet with Modified Thresholding [J].
Luo, Peng ;
Qu, Xilong ;
Qing, Xie ;
Gu, Jinjie .
2ND INTERNATIONAL CONFERENCE ON DATA SCIENCE AND BUSINESS ANALYTICS (ICDSBA 2018), 2018, :287-290
[24]  
Pei Soo-Chang, 2014, IEEE INT C MULTIMEDI
[25]   Large Kernel Matters - Improve Semantic Segmentation by Global Convolutional Network [J].
Peng, Chao ;
Zhang, Xiangyu ;
Yu, Gang ;
Luo, Guiming ;
Sun, Jian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1743-1751
[26]   Effect of periodic wakes and a contoured endwall on secondary flow in a high-lift low-pressure turbine cascade at low Reynolds numbers [J].
Qu, Xiao ;
Zhang, Yanfeng ;
Lu, Xingen ;
Lei, Zhijun ;
Zhu, Junqiang .
COMPUTERS & FLUIDS, 2019, 190 :1-14
[27]   Single Image Dehazing via Multi-scale Convolutional Neural Networks [J].
Ren, Wenqi ;
Liu, Si ;
Zhang, Hua ;
Pan, Jinshan ;
Cao, Xiaochun ;
Yang, Ming-Hsuan .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :154-169
[28]  
Ricci E, 2017, COMPUT VIS PATT REC, P67, DOI 10.1016/B978-0-12-809276-7.00005-9
[29]   The dual-tree complex wavelet transform [J].
Selesnick, IW ;
Baraniuk, RG ;
Kingsbury, NG .
IEEE SIGNAL PROCESSING MAGAZINE, 2005, 22 (06) :123-151
[30]   Algorithm for image stitching in the infrared [J].
Semenishchev, Evgenii ;
Voronin, Viacheslav ;
Zelensky, Aleksandr ;
Shraifel, Igor .
INFRARED TECHNOLOGY AND APPLICATIONS XLV, 2019, 11002