Detail-recovery Image Deraining via Context Aggregation Networks

被引:166
作者
Deng, Sen [1 ,2 ]
Wei, Mingqiang [1 ,2 ]
Wang, Jun [1 ,2 ]
Feng, Yidan [1 ,2 ]
Liang, Luming [3 ]
Xie, Haoran [4 ]
Wang, Fu Lee [5 ]
Wang, Meng [6 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[2] MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing, Peoples R China
[3] Microsoft Appl Sci Grp, Redmond, WA USA
[4] Lingnan Univ, Hong Kong, Peoples R China
[5] Open Univ Hong Kong, Hong Kong, Peoples R China
[6] Hefei Univ Technol, Hefei, Anhui, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020) | 2020年
基金
中国国家自然科学基金;
关键词
RAIN; REMOVAL; MODEL;
D O I
10.1109/CVPR42600.2020.01457
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper looks at this intriguing question: are single images with their details lost during deraining, reversible to their artifactfree status? We propose an end-to-end detail-recovery image deraining network (termed a DRD-Net) to solve the problem. Unlike existing image deraining approaches that attempt to meet the conflicting goal of simultaneously deraining and preserving details in a unified framework, we propose to view rain removal and detail recovery as two separate tasks, so that each part could be specialized rather than traded off. Specifically, we introduce two parallel sub-networks with a comprehensive loss function which synergize to derain and recover the lost details caused by deraining. For complete rain removal, we present a rain residual network with the squeeze-and-excitation (SE) operation to remove rain streaks from the rainy images. For detail recovery, we construct a specialized detail repair network consisting of well-designed blocks, named structure detail context aggregation block (SDCAB), to encourage the lost details to return for eliminating image degradations. Moreover; the detail recovery branch of our proposed detail repair framework is detachable and can be incorporated into existing deraining methods to boost their performances. DRD-Net has been validated on several well-known benchmark datasets in terms of deraining robustness and detail accuracy. Comparisons show clear visual and numerical improvements of our method over the state-of-the-arts'.
引用
收藏
页码:14548 / 14557
页数:10
相关论文
共 33 条
[21]   Removing rain from a single image via discriminative sparse coding [J].
Luo, Yu ;
Xu, Yong ;
Ji, Hui .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3397-3405
[22]   Progressive Image Deraining Networks: A Better and Simpler Baseline [J].
Ren, Dongwei ;
Zuo, Wangmeng ;
Hu, Qinghua ;
Zhu, Pengfei ;
Meng, Deyu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3932-3941
[23]   Utilizing Local Phase Information to Remove Rain from Video [J].
Santhaseelan, Varun ;
Asari, Vijayan K. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 112 (01) :71-89
[24]   Removal of rain from videos: a review [J].
Tripathi, Abhishek Kumar ;
Mukhopadhyay, Sudipta .
SIGNAL IMAGE AND VIDEO PROCESSING, 2014, 8 (08) :1421-1430
[25]   ERL-Net: Entangled Representation Learning for Single Image De-Raining [J].
Wang, Guoqing ;
Sun, Changming ;
Sowmya, Arcot .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5643-5651
[26]   Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset [J].
Wang, Tianyu ;
Yang, Xin ;
Xu, Ke ;
Chen, Shaozhe ;
Zhang, Qiang ;
Lau, Rynson W. H. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12262-12271
[27]   Semi-supervised Transfer Learning for Image Rain Removal [J].
Wei, Wei ;
Meng, Deyu ;
Zhao, Qian ;
Xu, Zongben ;
Wu, Ying .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3872-3881
[28]  
Yan S, 2016, ABS160907769 CORR, V2
[29]  
YANG WH, 2017, PROC CVPR IEEE, P1685, DOI DOI 10.1109/CVPR.2017.183
[30]   Density-aware Single Image De-raining using a Multi-stream Dense Network [J].
Zhang, He ;
Patel, Vishal M. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :695-704