3-D Object Detection for Multiframe 4-D Automotive Millimeter-Wave Radar Point Cloud

被引:44
作者
Tan, Bin [1 ]
Ma, Zhixiong [1 ]
Zhu, Xichan [1 ]
Li, Sen [1 ]
Zheng, Lianqing [1 ]
Chen, Sihan [1 ]
Huang, Libo [2 ]
Bai, Jie [2 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 201804, Peoples R China
[2] Zhejiang Univ City Coll, Sch Informat & Elect, Hangzhou 310015, Zhejiang, Peoples R China
关键词
Millimeter wave radar; Radar; Three-dimensional displays; Laser radar; Point cloud compression; Sensors; Radar detection; Autonomous driving; deep learning; millimeter-wave radar; object detection; point clouds; EGO-MOTION ESTIMATION; 3D;
D O I
10.1109/JSEN.2022.3219643
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object detection is a crucial task in autonomous driving. Currently, object-detection methods for autonomous driving systems are primarily based on information from cameras and light detection and ranging (LiDAR), which may experience interference from complex lighting or poor weather. At present, the 4-D (x, y, z, v) millimeter-wave radar can provide a denser point cloud to achieve 3-D object-detection tasks that are difficult to complete with traditional millimeter wave radar. Existing 3-D object point-cloud-detection algorithms are mostly based on 3-D LiDAR; these methods are not necessarily applicable to millimeter-wave radars, which have sparser data and more noise and include velocity information. This study proposes a 3-D object-detection framework based on a multiframe 4-D millimeter-wave radar point cloud. First, the ego vehicle velocity information is estimated by the millimeter-wave radar, and the relative velocity information of the millimeter-wave radar point cloud is compensated for the absolute velocity. Second, by matching between millimeter-wave radar frames, the multiframe millimeter-wave radar point cloud is matched to the last frame. Finally, the object is detected by the proposed multiframe millimeter-wave radar point-cloud-detection network. Experiments are performed using our newly recorded TJ4DRadSet dataset in a complex traffic environment. The results showed that the proposed object-detection framework outperformed the comparison methods based on the 3-D mean average precision. The experimental results and methods can be used as the baseline for other multiframe 4-D millimeter-wave radar-detection algorithms.
引用
收藏
页码:11125 / 11138
页数:14
相关论文
共 37 条
[1]   Milli-RIO: Ego-Motion Estimation With Low-Cost Millimetre-Wave Radar [J].
Almalioglu, Yasin ;
Turan, Mehmet ;
Lu, Chris Xiaoxuan ;
Trigoni, Niki ;
Markham, Andrew .
IEEE SENSORS JOURNAL, 2021, 21 (03) :3314-3323
[2]   Sensing system of environmental perception technologies for driverless vehicle: A review of state of the art and challenges [J].
Chen, Qiping ;
Xie, Yinfei ;
Guo, Shifeng ;
Bai, Jie ;
Shu, Qiang .
SENSORS AND ACTUATORS A-PHYSICAL, 2021, 319
[3]  
Danzer A, 2019, IEEE INT C INTELL TR, P61, DOI 10.1109/ITSC.2019.8917000
[4]  
Derpanis K.G., 2010, Image Rochester NY, V4, P2
[5]   Point-cloud based 3D object detection and classification methods for self-driving applications: A survey and taxonomy [J].
Fernandes, Duarte ;
Silva, Antonio ;
Nevoa, Rafael ;
Simoes, Claudia ;
Gonzalez, Dibet ;
Guevara, Miguel ;
Novais, Paulo ;
Monteiro, Joao ;
Melo-Pinto, Pedro .
INFORMATION FUSION, 2021, 68 :161-191
[6]  
Holder M, 2019, IEEE INT VEH SYM, P1145, DOI 10.1109/IVS.2019.8813841
[7]  
Huang R, 2020, Arxiv, DOI arXiv:2007.12392
[8]  
Kellner D, 2013, IEEE INT C INTELL TR, P869, DOI 10.1109/ITSC.2013.6728341
[9]   PointPillars: Fast Encoders for Object Detection from Point Clouds [J].
Lang, Alex H. ;
Vora, Sourabh ;
Caesar, Holger ;
Zhou, Lubing ;
Yang, Jiong ;
Beijbom, Oscar .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12689-12697
[10]  
Liu Z, 2020, AAAI CONF ARTIF INTE, V34, P11677