Pseudo-Image and Sparse Points: Vehicle Detection With 2D LiDAR Revisited by Deep Learning-Based Methods

被引:26
作者
Chen, Guang [1 ,2 ,3 ]
Wang, Fa [1 ]
Qu, Sanqing [1 ]
Chen, Kai [1 ]
Yu, Junwei [1 ]
Liu, Xiangyong [1 ]
Xiong, Lu [1 ]
Knoll, Alois [3 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 200092, Peoples R China
[2] State Key Lab Adv Design & Mfg Vehicle Body, Changsha 410082, Peoples R China
[3] Tech Univ Munich, Dept Informat, D-80333 Munich, Germany
基金
中国国家自然科学基金; 欧盟地平线“2020”;
关键词
Laser radar; Two dimensional displays; Three-dimensional displays; Robot sensing systems; Vehicle detection; Machine learning; Robustness; 2D LiDAR; autonomous driving; deep learning; intelligent transportation system; NEUROMORPHIC VISION;
D O I
10.1109/TITS.2020.3007631
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Detecting and locating surrounding vehicles robustly and efficiently are essential capabilities for autonomous vehicles. Existing solutions often rely on vision-based methods or 3D LiDAR-based methods. These methods are either too expensive in both sensor pricing (3D LiDAR) and computation (camera and 3D LiDAR) or less robust in resisting harsh environment changes (camera). In this work, we revisit the LiDAR based approaches for vehicle detection with a less expensive 2D LiDAR by utilizing modern deep learning approaches. We aim at filling in the gap as few previous works conclude an efficient and robust vehicle detection solution in a deep learning way in 2D. To this end, we propose a learning based method with the input of pseudo-images, named Cascade Pyramid Region Proposal Convolution Neural Network (Cascade Pyramid RCNN), and a hybrid learning method with the input of sparse points, named Hybrid Resnet Lite. Experiments are conducted with our newly 2D LiDAR vehicle dataset recorded in complex traffic environments. Results demonstrate that the Cascade Pyramid RCNN outperforms state-of-the-art methods in accuracy while the proposed Hybrid Resnet Lite provides superior performance of the speed and lightweight model by hybridizing learning based and non-learning based modules. As few previous works conclude an efficient and robust vehicle detection solution with 2D LiDAR, our research fills in this gap and illustrates that even with limited sensing source from a 2D LiDAR, detecting obstacles like vehicles efficiently and robustly is still achievable.
引用
收藏
页码:7699 / 7711
页数:13
相关论文
共 56 条
[1]  
[Anonymous], 2017, IEEE INT C COMPUT VI, DOI [10.1109/iccv.201, DOI 10.1109/ICCV.2017.322]
[2]   Using boosted features for the detection of people in 2D range data [J].
Arras, Kai O. ;
Mozos, Oscar Martinez ;
Burgard, Wolfram .
PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-10, 2007, :3402-+
[3]  
Beyer L., 2018, ARXIV180402463
[4]   DROW: Real-Time Deep Learning-Based Wheelchair Detection in 2-D Range Data [J].
Beyer, Lucas ;
Hermans, Alexander ;
Leibe, Bastian .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02) :585-592
[5]   A Survey of the Four Pillars for Small Object Detection: Multiscale Representation, Contextual Information, Super-Resolution, and Region Proposal [J].
Chen, Guang ;
Wang, Haitao ;
Chen, Kai ;
Li, Zhijun ;
Song, Zida ;
Liu, Yinlong ;
Chen, Wenkai ;
Knoll, Alois .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (02) :936-953
[6]   Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception [J].
Chen, Guang ;
Cao, Hu ;
Conradt, Jorg ;
Tang, Huajin ;
Rohrbein, Florian ;
Knoll, Alois .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (04) :34-49
[7]   EDDD: Event-Based Drowsiness Driving Detection Through Facial Motion Analysis With Neuromorphic Vision Sensor [J].
Chen, Guang ;
Hong, Lin ;
Dong, Jinhu ;
Liu, Peigen ;
Conradt, Joerg ;
Knoll, Alois .
IEEE SENSORS JOURNAL, 2020, 20 (11) :6170-6181
[8]   Multi-View 3D Object Detection Network for Autonomous Driving [J].
Chen, Xiaozhi ;
Ma, Huimin ;
Wan, Ji ;
Li, Bo ;
Xia, Tian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6526-6534
[9]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[10]  
Engelcke Martin, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P1355, DOI 10.1109/ICRA.2017.7989161