Prior-Based Domain Adaptive Object Detection for Hazy and Rainy Conditions

被引:136
作者
Sindagi, Vishwanath A. [1 ]
Oza, Poojan [1 ]
Yasarla, Rajeev [1 ]
Patel, Vishal M. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, 3400 Charles St, Baltimore, MD 21218 USA
来源
COMPUTER VISION - ECCV 2020, PT XIV | 2020年 / 12359卷
关键词
Detection; Unsupervised domain adaptation; Adverse weather; Rain; Haze;
D O I
10.1007/978-3-030-58568-6_45
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Adverse weather conditions such as haze and rain corrupt the quality of captured images, which cause detection networks trained on clean images to perform poorly on these corrupted images. To address this issue, we propose an unsupervised prior-based domain adversarial object detection framework for adapting the detectors to hazy and rainy conditions. In particular, we use weather-specific prior knowledge obtained using the principles of image formation to define a novel prior-adversarial loss. The prior-adversarial loss, which we use to supervise the adaptation process, aims to reduce the weather-specific information in the features, thereby mitigating the effects of weather on the detection performance. Additionally, we introduce a set of residual feature recovery blocks in the object detection pipeline to de-distort the feature space, resulting in further improvements. Evaluations performed on various datasets (Foggy-Cityscapes, Rainy-Cityscapes, RTTS and UFDD) for rainy and hazy conditions demonstrates the effectiveness of the proposed approach.
引用
收藏
页码:763 / 780
页数:18
相关论文
共 64 条
[41]   Automatic adaptation of object detectors to new domains using self-training [J].
RoyChowdhury, Aruni ;
Chakrabarty, Prithvijit ;
Singh, Ashish ;
Jin, SouYoung ;
Jiang, Huaizu ;
Cao, Liangliang ;
Learned-Miller, Erik .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :780-790
[42]   Strong-Weak Distribution Alignment for Adaptive Object Detection [J].
Saito, Kuniaki ;
Ushiku, Yoshitaka ;
Harada, Tatsuya ;
Saenko, Kate .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :6949-6958
[43]   Maximum Classifier Discrepancy for Unsupervised Domain Adaptation [J].
Saito, Kuniaki ;
Watanabe, Kohei ;
Ushiku, Yoshitaka ;
Harada, Tatsuya .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3723-3732
[44]   Semantic Foggy Scene Understanding with Synthetic Data [J].
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (09) :973-992
[45]   Generate To Adapt: Aligning Domains using Generative Adversarial Networks [J].
Sankaranarayanan, Swami ;
Balaji, Yogesh ;
Castillo, Carlos D. ;
Chellappa, Rama .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8503-8512
[46]  
Shan Y., 2018, Pixel and feature level based domain adaption for object detection in autonomous driving
[47]  
Shu R, 2018, Arxiv, DOI [arXiv:1802.08735, DOI 10.48550/ARXIV.1802.08735]
[48]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[49]   Pushing the Frontiers of Unconstrained Crowd Counting: New Dataset and Benchmark Method [J].
Sindagi, Vishwanath A. ;
Yasarla, Rajeev ;
Patel, Vishal M. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1221-1231
[50]   DAFE-FD: Density Aware Feature Enrichment for Face Detection [J].
Sindagi, Vishwanath A. ;
Patel, Vishal M. .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :2185-2195