RT3D: Real-Time 3-D Vehicle Detection in LiDAR Point Cloud for Autonomous Driving

被引:124
作者
Zeng, Yiming [1 ,2 ]
Hu, Yu [1 ,2 ]
Liu, Shice [1 ,2 ]
Ye, Jing [1 ,2 ]
Han, Yinhe [1 ,2 ]
Li, Xiaowei [1 ,2 ]
Sun, Ninghui [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2018年 / 3卷 / 04期
基金
中国国家自然科学基金;
关键词
Object detection; segmentation and categorization; autonomous agents;
D O I
10.1109/LRA.2018.2852843
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
For autonomous driving, vehicle detection is the prerequisite for many tasks like collision avoidance and path planning. In this letter, we present a real-time three-dimensional (RT3D) vehicle detection method that utilizes pure LiDAR point cloud to predict the location, orientation, and size of vehicles. In contrast to previous 3-D object detection methods, we used a pre-RoIpooling convolution technique that moves a majority of the convolution operations to ahead of the RoI pooling, leaving just a small part behind, so that significantly boosts the computation efficiency. We also propose a pose-sensitive feature map design which can be strongly activated by the relative poses of vehicles, leading to a high regression accuracy on the location, orientation, and size of vehicles. Experiments on the KITTI benchmark dataset show that the RT3D is not only able to deliver competitive detection accuracy against state-of-the-art methods, but also the first LiDAR-based 3-D vehicle detection work that completes detection within 0.09 s which is even shorter than the scan period of mainstream LiDAR sensors.
引用
收藏
页码:3434 / 3440
页数:7
相关论文
共 50 条
  • [1] Real-Time Driving Scene Understanding via Efficient 3-D LIDAR Processing
    Jang, Wonje
    Park, Minseong
    Kim, Euntai
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] Real-Time Semantic Segmentation of 3D LiDAR Point Clouds for Aircraft Engine Detection in Autonomous Jetbridge Operations
    Weon, Ihnsik
    Lee, Soongeul
    Yoo, Juhan
    APPLIED SCIENCES-BASEL, 2024, 14 (21):
  • [3] PLOT: a 3D point cloud object detection network for autonomous driving
    Zhang, Yihuan
    Wang, Liang
    Dai, Yifan
    ROBOTICA, 2023, 41 (05) : 1483 - 1499
  • [4] YOLO3D: End-to-End Real-Time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud
    Ali, Waleed
    Abdelkarim, Sherif
    Zidan, Mahmoud
    Zahran, Mohamed
    El Sallab, Ahmad
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 : 716 - 728
  • [5] Unsupervised Domain Adaptive 3-D Detection With Data Adaption From LiDAR Point Cloud
    Zhang, Diankun
    Wang, Xueqing
    Zheng, Zhijie
    Liu, Xiaojun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Real-time 3D-LiDAR object detection in autonomous vehicle systems using cluster-based candidates and deep learning
    Kim M.-G.
    Bae S.-H.
    Kim H.
    Journal of Institute of Control, Robotics and Systems, 2019, 25 (09): : 795 - 801
  • [7] Real LiDAR point cloud synthesis for 3D object detection in snowy weather
    Chen, Yuhao
    Li, Guanghe
    Zhang, Boxiang
    Zou, Xiaolin
    Wang, Ying
    Li, Ximing
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2025,
  • [8] Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation
    Wang, Bo
    Zhu, Ming
    Lu, Ying
    Wang, Jiarong
    Gao, Wen
    Wei, Hua
    IEEE ACCESS, 2021, 9 : 84886 - 84898
  • [9] FP-RCNN: A Real-Time 3D Target Detection Model based on Multiple Foreground Point Sampling for Autonomous Driving
    Xu, Guoqing
    Xu, Xiaolong
    Gao, Honghao
    Xiao, Fu
    MOBILE NETWORKS & APPLICATIONS, 2023, 28 (01) : 369 - 381
  • [10] 3D Object Detection Method for Autonomous Vehicle Based on Sparse Color Point Cloud
    Luo Y.
    Qin H.
    Qiche Gongcheng/Automotive Engineering, 2021, 43 (04): : 492 - 500