Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

被引:11
|
作者
Luo, Xizhao [1 ]
Zhou, Feng [2 ]
Tao, Chongben [2 ,3 ]
Yang, Anjia [4 ,5 ]
Zhang, Peiyun [6 ]
Chen, Yonghua [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Suzhou Univ Sci & Technol, Sch Elect & Informat Engn, Suzhou 215009, Peoples R China
[3] Tsinghua Univ, Suzhou Automobile Res Inst, Suzhou 215134, Peoples R China
[4] Jinan Univ, Sch Informat Sci & Technol, Guangzhou 510632, Peoples R China
[5] Jinan Univ, Sch Cyber Secur, Guangzhou 510632, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Three-dimensional displays; Point cloud compression; Object detection; Cameras; Heuristic algorithms; Autonomous vehicles; 3D target detection; autonomous driving; PointRCNN; multi-feature fusion; OBJECT DETECTION; VEHICLE; NETWORK; VISION;
D O I
10.1109/TITS.2022.3176390
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Current 3D target detection methods used in the field of autonomous driving generally have low real-time performance and insufficient target context feature to detect dynamic multi-target accurately. In order to solve these problems, a dynamic multi-target detection algorithm of voxel point cloud fusion based on PointRCNN is proposed, which adopts a two-stage detection structure. The first stage directly processes the point cloud to extract key point features and divides voxel space. A novel submanifold sparse convolution is used to extract voxel features. Then key point features and voxel features of the point cloud are merged to generate pre-selection boxes. In the second stage, reference points are set based on the voxel features. The features of key points around reference points are merged for the second time to achieve optimized detection boxes. Finally, for the problem of inconsistent confidence, a mandatory consistency loss function is proposed to improve the accuracy of the detection box. The proposed algorithm was compared with other algorithms in three different datasets, and further tested on a self-made dataset from an actual vehicle platform. Results showed that the proposed algorithm had higher accuracy, better robustness, stronger generalization ability for dynamic multi-target detection.
引用
收藏
页码:20707 / 20720
页数:14
相关论文
共 50 条
  • [21] PV-EncoNet: Fast Object Detection Based on Colored Point Cloud
    Ouyang, Zhenchao
    Dong, Xiaoyun
    Cui, Jiahe
    Niu, Jianwei
    Guizani, Mohsen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 12439 - 12450
  • [22] A Dynamic Multitarget Detection Algorithm in front of Vehicle Based on Embedded System and Internet of Things
    Dou, Huili
    Wang, Guohua
    SCIENTIFIC PROGRAMMING, 2022, 2022
  • [23] A Pedestrian Detection Algorithm Based on Score Fusion for Multi-LiDAR Systems
    Wu, Tao
    Hu, Jun
    Ye, Lei
    Ding, Kai
    SENSORS, 2021, 21 (04) : 1 - 16
  • [24] Gentle Adaboost algorithm based on multi-feature fusion for face detection
    Yan, Chen
    Wang, Zhengqun
    Xu, Chunlin
    JOURNAL OF ENGINEERING-JOE, 2019, (15): : 609 - 612
  • [25] Point Cloud Feature Extraction Network Based on Multiscale Feature Dynamic Fusion
    Liu, Jing
    Zhang, Yuan
    Zhang, Le
    Li, Bo
    Yang, Xiaowen
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [26] Road Traffic Marking Extraction Algorithm Based on Fusion of Single Frame Image and Sparse Point Cloud
    Yu, Fei
    Lu, Zhaoxia
    IEEE ACCESS, 2023, 11 : 88881 - 88894
  • [27] Automatic Point Cloud Registration Based on Voxel Downsampling and Key Point Extraction
    Zhang Bin
    Xiong Chuanbing
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [28] Multisensor Fusion for Vehicle-to-Vehicle Cooperative Localization With Object Detection and Point Cloud Matching
    Gao, Letian
    Xiang, Hao
    Xia, Xin
    Ma, Jiaqi
    IEEE SENSORS JOURNAL, 2024, 24 (07) : 10865 - 10877
  • [29] Semantic Point Cloud-Based Adaptive Multiple Object Detection and Tracking for Autonomous Vehicles
    Kim, Soyeong
    Ha, Jinsu
    Jo, Kichun
    IEEE ACCESS, 2021, 9 : 157550 - 157562
  • [30] PANet: A Point-Attention Based Multi-Scale Feature Fusion Network for Point Cloud Registration
    Wu, Yue
    Yao, Qianlin
    Fan, Xiaolong
    Gong, Maoguo
    Ma, Wenping
    Miao, Qiguang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72