Deep Multi-modal Object Detection for Autonomous Driving

被引:6
作者
Ennajar, Amal [1 ]
Khouja, Nadia [1 ]
Boutteau, Remi [2 ]
Tlili, Fethi [1 ]
机构
[1] Sup Com, Grescom Lab, Tunis, Tunisia
[2] Normandie Univ, UNIROUEN, UNILEHAVRE, INSA Rouen,LITIS, F-76000 Rouen, France
来源
2021 18TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD) | 2021年
关键词
multi-modality; object detection; deep learning; autonomous driving; simulators; datasets; sensors fusion; POINT CLOUD;
D O I
10.1109/SSD52085.2021.9429355
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Robust perception in autonomous vehicles is a huge challenge that is the main tool for detecting and tracking the different kinds of objects around the vehicle. The aim is to reach the capability of the human level, which is frequently realized by taking utility of several sensing modalities. This lead to make the sensor combination a main part of the recognition system. In this paper, we present methods that have been proposed in the literature for the different deep multi-modal perception techniques. We focus on works dealing with the combination of radar information with other sensors. The radar data are in fact very important mainly when weather conditions and precipitation affect the quality of the data. In this case, it is crucial to have at least some sensors that are immunized against different weather conditions and radar is one of them.
引用
收藏
页码:7 / 11
页数:5
相关论文
共 24 条
[1]   nuScenes: A multimodal dataset for autonomous driving [J].
Caesar, Holger ;
Bankiti, Varun ;
Lang, Alex H. ;
Vora, Sourabh ;
Liong, Venice Erin ;
Xu, Qiang ;
Krishnan, Anush ;
Pan, Yu ;
Baldan, Giancarlo ;
Beijbom, Oscar .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11618-11628
[2]  
Chadwick S, 2019, IEEE INT CONF ROBOT, P8311, DOI [10.1109/icra.2019.8794312, 10.1109/ICRA.2019.8794312]
[3]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[4]  
Dosovitskiy A., 2017, PROC 1 ANN C ROBOT L, DOI DOI 10.48550/ARXIV.1711.03938
[5]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[6]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[7]  
Guo R., 2020, ARXIV
[8]  
L. E. A. R. Center, 2020, LGSVL SIM AUT VEH SI
[9]  
Lee SJ, 2020, Arxiv, DOI [arXiv:2003.00851, DOI 10.48550/ARXIV.2003.00851]
[10]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37