Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

被引:11
|
作者
Luo, Xizhao [1 ]
Zhou, Feng [2 ]
Tao, Chongben [2 ,3 ]
Yang, Anjia [4 ,5 ]
Zhang, Peiyun [6 ]
Chen, Yonghua [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Suzhou Univ Sci & Technol, Sch Elect & Informat Engn, Suzhou 215009, Peoples R China
[3] Tsinghua Univ, Suzhou Automobile Res Inst, Suzhou 215134, Peoples R China
[4] Jinan Univ, Sch Informat Sci & Technol, Guangzhou 510632, Peoples R China
[5] Jinan Univ, Sch Cyber Secur, Guangzhou 510632, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Three-dimensional displays; Point cloud compression; Object detection; Cameras; Heuristic algorithms; Autonomous vehicles; 3D target detection; autonomous driving; PointRCNN; multi-feature fusion; OBJECT DETECTION; VEHICLE; NETWORK; VISION;
D O I
10.1109/TITS.2022.3176390
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Current 3D target detection methods used in the field of autonomous driving generally have low real-time performance and insufficient target context feature to detect dynamic multi-target accurately. In order to solve these problems, a dynamic multi-target detection algorithm of voxel point cloud fusion based on PointRCNN is proposed, which adopts a two-stage detection structure. The first stage directly processes the point cloud to extract key point features and divides voxel space. A novel submanifold sparse convolution is used to extract voxel features. Then key point features and voxel features of the point cloud are merged to generate pre-selection boxes. In the second stage, reference points are set based on the voxel features. The features of key points around reference points are merged for the second time to achieve optimized detection boxes. Finally, for the problem of inconsistent confidence, a mandatory consistency loss function is proposed to improve the accuracy of the detection box. The proposed algorithm was compared with other algorithms in three different datasets, and further tested on a self-made dataset from an actual vehicle platform. Results showed that the proposed algorithm had higher accuracy, better robustness, stronger generalization ability for dynamic multi-target detection.
引用
收藏
页码:20707 / 20720
页数:14
相关论文
共 50 条
  • [1] Real-Time Point Cloud Object Detection via Voxel-Point Geometry Abstraction
    Shi, Guangsheng
    Wang, Ke
    Li, Ruifeng
    Ma, Chao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) : 5971 - 5982
  • [2] Dense Sequential Fusion: Point Cloud Enhancement Using Foreground Mask Guidance for Multimodal 3-D Object Detection
    Xie, Chen
    Lin, Ciyun
    Zheng, Xiaoyu
    Gong, Bowen
    Liu, Hongchao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 15
  • [3] SP-Det: Leveraging Saliency Prediction for Voxel-Based 3D Object Detection in Sparse Point Cloud
    An, Pei
    Duan, Yucong
    Huang, Yuliang
    Ma, Jie
    Chen, Yanfei
    Wang, Liheng
    Yang, You
    Liu, Qiong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 (2795-2808) : 2795 - 2808
  • [4] Multitarget Detection Algorithm Based on Multimodal Information Fusion
    Liu Tong
    Gao Sijie
    Nie Weizhi
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (08)
  • [5] Survey on Image and Point-Cloud Fusion-Based Object Detection in Autonomous Vehicles
    Peng, Ying
    Qin, Yechen
    Tang, Xiaolin
    Zhang, Zhiqiang
    Deng, Lei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 22772 - 22789
  • [6] HCPVF: Hierarchical Cascaded Point-Voxel Fusion for 3D Object Detection
    Fan, Baojie
    Zhang, Kexin
    Tian, Jiandong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 8997 - 9009
  • [7] Laser Point Cloud-Image Fusion Technology for Intelligent Driving Vehicles Based on Semi-Supervised Learning Algorithm
    Lan, Jianping
    Dong, Xiujuan
    IEEE ACCESS, 2024, 12 : 132664 - 132676
  • [8] GNSS NLOS Exclusion Based on Dynamic Object Detection Using LiDAR Point Cloud
    Wen, Weisong
    Zhang, Guohao
    Hsu, Li-Ta
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (02) : 853 - 862
  • [9] PV-SSD: A Multi-Modal Point Cloud 3D Object Detector Based on Projection Features and Voxel Features
    Shao, Yongxin
    Tan, Aihong
    Sun, Zhetao
    Zheng, Enhui
    Yan, Tianhong
    Liao, Peng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 3436 - 3449
  • [10] STFNET: Sparse Temporal Fusion for 3D Object Detection in LiDAR Point Cloud
    Meng, Xin
    Zhou, Yuan
    Ma, Jun
    Jiang, Fangdi
    Qi, Yongze
    Wang, Cui
    Kim, Jonghyuk
    Wang, Shifeng
    IEEE SENSORS JOURNAL, 2025, 25 (03) : 5866 - 5877