Detail-recovery Image Deraining via Context Aggregation Networks

被引:166
作者
Deng, Sen [1 ,2 ]
Wei, Mingqiang [1 ,2 ]
Wang, Jun [1 ,2 ]
Feng, Yidan [1 ,2 ]
Liang, Luming [3 ]
Xie, Haoran [4 ]
Wang, Fu Lee [5 ]
Wang, Meng [6 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing, Peoples R China
[3] Microsoft Appl Sci Grp, Redmond, WA USA
[4] Lingnan Univ, Hong Kong, Peoples R China
[5] Open Univ Hong Kong, Hong Kong, Peoples R China
[6] Hefei Univ Technol, Hefei, Anhui, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020) | 2020年
基金
中国国家自然科学基金;
关键词
RAIN; REMOVAL; MODEL;
D O I
10.1109/CVPR42600.2020.01457
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper looks at this intriguing question: are single images with their details lost during deraining, reversible to their artifactfree status? We propose an end-to-end detail-recovery image deraining network (termed a DRD-Net) to solve the problem. Unlike existing image deraining approaches that attempt to meet the conflicting goal of simultaneously deraining and preserving details in a unified framework, we propose to view rain removal and detail recovery as two separate tasks, so that each part could be specialized rather than traded off. Specifically, we introduce two parallel sub-networks with a comprehensive loss function which synergize to derain and recover the lost details caused by deraining. For complete rain removal, we present a rain residual network with the squeeze-and-excitation (SE) operation to remove rain streaks from the rainy images. For detail recovery, we construct a specialized detail repair network consisting of well-designed blocks, named structure detail context aggregation block (SDCAB), to encourage the lost details to return for eliminating image degradations. Moreover; the detail recovery branch of our proposed detail repair framework is detachable and can be incorporated into existing deraining methods to boost their performances. DRD-Net has been validated on several well-known benchmark datasets in terms of deraining robustness and detail accuracy. Comparisons show clear visual and numerical improvements of our method over the state-of-the-arts'.
引用
收藏
页码:14548 / 14557
页数:10
相关论文
共 33 条
[1]  
[Anonymous], IEEE I CONF COMP VIS
[2]  
[Anonymous], 2017, IMAGE DERAINING USIN
[3]   Analysis of Rain and Snow in Frequency Space [J].
Barnum, Peter C. ;
Narasimhan, Srinivasa ;
Kanade, Takeo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 86 (2-3) :256-274
[4]   Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks [J].
Bossu, Jeremie ;
Hautiere, Nicolas ;
Tarel, Jean-Philippe .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :348-367
[5]  
De-An Huang, 2012, 2012 IEEE International Conference on Multimedia and Expo (ICME), P164, DOI 10.1109/ICME.2012.92
[6]   A directional global sparse model for single image rain removal [J].
Deng, Liang-Jian ;
Huang, Ting-Zhu ;
Zhao, Xi-Le ;
Jiang, Tai-Xiang .
APPLIED MATHEMATICAL MODELLING, 2018, 59 :662-679
[7]   Residual-Guide Network for Single Image Deraining [J].
Fan, Zhiwen ;
Wu, Huafeng ;
Fu, Xueyang ;
Huang, Yue ;
Ding, Xinghao .
PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, :1751-1759
[8]   Removing rain from single images via a deep detail network [J].
Fu, Xueyang ;
Huang, Jiabin ;
Zeng, Delu ;
Huang, Yue ;
Ding, Xinghao ;
Paisley, John .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1715-1723
[9]  
Garg K, 2004, PROC CVPR IEEE, P528
[10]   Robust Low-rank subspace segmentation with finite mixture noise [J].
Guo, Xianglin ;
Xie, Xingyu ;
Liu, Guangcan ;
Wei, Mingqiang ;
Wang, Jun .
PATTERN RECOGNITION, 2019, 93 :55-67