The PolarLITIS Dataset: Road Scenes Under Fog

被引:9
作者
Blin, Rachel [1 ]
Ainouz, Samia [1 ]
Canu, Stephane [1 ]
Meriaudeau, Fabrice [2 ]
机构
[1] Normandie Univ, UNIHAVRE INSA Rouen Normandie, LITIS, UNIROUEN, F-76000 Rouen, France
[2] Univ Burgundy, UBFC, ImViA, F-71200 Le Creusot, France
关键词
Roads; Meteorology; Mathematical model; Stokes parameters; Sensors; Cameras; Autonomous vehicles; Road scene analysis; autonomous vehicles; polarimetric imaging; adverse weather; deep learning; object detection;
D O I
10.1109/TITS.2021.3095658
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road scene analysis is a fundamental task for both autonomous vehicles and ADAS systems. Nowadays, one can find autonomous vehicles that are able to properly detect objects in the scene in good weather conditions; however, some improvements still need to be done when the visibility is altered. People claim that using some non-conventional sensors such as, infra-red or Lidar, combined with classical vision, enhances road scene analysis in optimal weather conditions. In this work, we present the improvements achieved using polarimetric imaging in the complex situation of some adverse weather conditions. This rich modality is known for its ability to describe an object not only by its intensity information, even under poor illumination or strong reflection. The experimental results have shown that, using a new multimodal dataset, polarimetric imaging was able to provide generic features for both good weather conditions and adverse weather conditions, especially fog. By combining polarimetric images with an adapted learning model, the different detection tasks under fog were improved by about 15% to 44%.
引用
收藏
页码:10753 / 10762
页数:10
相关论文
共 34 条
[21]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[22]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[23]   Single-pass polarimetric SAR interferometry for vessel classification [J].
Margarit, Gerard ;
Mallorqui, Jordi J. ;
Fabregas, Xavier .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (11) :3494-3502
[24]   Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging [J].
Morel, Olivier ;
Stolz, Christophe ;
Meriaudeau, Fabrice ;
Gorria, Patrick .
APPLIED OPTICS, 2006, 45 (17) :4062-4068
[25]   Learning and Transferring Mid-Level Image Representations using Convolutional Neural Networks [J].
Oquab, Maxime ;
Bottou, Leon ;
Laptev, Ivan ;
Sivic, Josef .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1717-1724
[26]   All-Weather Vision for Automotive Safety: Which Spectral Band? [J].
Pinchon, Nicolas ;
Cassignol, Olivier ;
Nicolas, Adrien ;
Bernardin, Frederic ;
Leduc, Patrick ;
Tarel, Jean-Philippe ;
Bremond, Roland ;
Bercier, Emmanuel ;
Brunet, Johann .
ADVANCED MICROSYSTEMS FOR AUTOMOTIVE APPLICATIONS 2018: SMART SYSTEMS FOR CLEAN, SAFE AND SHARED ROAD VEHICLES, 2019, :3-15
[27]  
Redmon J, 2018, Arxiv, DOI arXiv:1804.02767
[28]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[29]   Polarization-based vision through haze [J].
Schechner, YY ;
Narasimhan, SG ;
Nayar, SK .
APPLIED OPTICS, 2003, 42 (03) :511-525
[30]   Fusion of PolSAR and PolInSAR data for land cover classification [J].
Shimoni, M. ;
Borghys, D. ;
Heremans, R. ;
Perneel, C. ;
Acheroy, M. .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2009, 11 (03) :169-180