Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

被引:11
|
作者
Luo, Xizhao [1 ]
Zhou, Feng [2 ]
Tao, Chongben [2 ,3 ]
Yang, Anjia [4 ,5 ]
Zhang, Peiyun [6 ]
Chen, Yonghua [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Suzhou Univ Sci & Technol, Sch Elect & Informat Engn, Suzhou 215009, Peoples R China
[3] Tsinghua Univ, Suzhou Automobile Res Inst, Suzhou 215134, Peoples R China
[4] Jinan Univ, Sch Informat Sci & Technol, Guangzhou 510632, Peoples R China
[5] Jinan Univ, Sch Cyber Secur, Guangzhou 510632, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Three-dimensional displays; Point cloud compression; Object detection; Cameras; Heuristic algorithms; Autonomous vehicles; 3D target detection; autonomous driving; PointRCNN; multi-feature fusion; OBJECT DETECTION; VEHICLE; NETWORK; VISION;
D O I
10.1109/TITS.2022.3176390
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Current 3D target detection methods used in the field of autonomous driving generally have low real-time performance and insufficient target context feature to detect dynamic multi-target accurately. In order to solve these problems, a dynamic multi-target detection algorithm of voxel point cloud fusion based on PointRCNN is proposed, which adopts a two-stage detection structure. The first stage directly processes the point cloud to extract key point features and divides voxel space. A novel submanifold sparse convolution is used to extract voxel features. Then key point features and voxel features of the point cloud are merged to generate pre-selection boxes. In the second stage, reference points are set based on the voxel features. The features of key points around reference points are merged for the second time to achieve optimized detection boxes. Finally, for the problem of inconsistent confidence, a mandatory consistency loss function is proposed to improve the accuracy of the detection box. The proposed algorithm was compared with other algorithms in three different datasets, and further tested on a self-made dataset from an actual vehicle platform. Results showed that the proposed algorithm had higher accuracy, better robustness, stronger generalization ability for dynamic multi-target detection.
引用
收藏
页码:20707 / 20720
页数:14
相关论文
共 50 条
  • [41] A Scalable BEV Perception Processor for Image/Point Cloud Fusion Applications Using CAM-Based Universal Mapping Unit
    Feng, Xiaoyu
    Lin, Xinyuan
    Yang, Huazhong
    Liu, Yongpan
    Sun, Wenyu
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2025, 60 (03) : 1002 - 1013
  • [42] RGB-D Point Cloud Registration Based on Salient Object Detection
    Wan, Teng
    Du, Shaoyi
    Cui, Wenting
    Yao, Runzhao
    Ge, Yuyan
    Li, Ce
    Gao, Yue
    Zheng, Nanning
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3547 - 3559
  • [43] Detection and Tracking Dynamic Vehicles for Autonomous Driving Based on 2-D Point Scans
    Wang, Hengyang
    Liu, Biao
    IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2178 - 2188
  • [44] Point Cloud Segmentation Algorithm Based on Improved Euclidean Clustering
    Chen, Fangrui
    Xie, Feifei
    Sun, Lin
    Gu, Yuchao
    Zhang, Zhipeng
    Chen, Jinpeng
    Zhang, Jinrui
    Yi, Mingzhe
    IEEE ACCESS, 2024, 12 : 152959 - 152971
  • [45] 3D Object Detection and Tracking Based on Lidar-Camera Fusion and IMM-UKF Algorithm Towards Highway Driving
    Nie, Chang
    Ju, Zhiyang
    Sun, Zhifeng
    Zhang, Hui
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 1242 - 1252
  • [46] An Improved Faster R-CNN Pedestrian Detection Algorithm Based on Feature Fusion and Context Analysis
    Zhai, Sheping
    Dong, Susu
    Shang, Dingrong
    Wang, Shuhuan
    IEEE ACCESS, 2020, 8 (08): : 138117 - 138128
  • [47] Visual Object Detection based LiDAR Point Cloud Classification
    Muhammad, Sualeh
    Gon-Woo, Kim
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 438 - 440
  • [48] Point Cloud 3D Object Detection Based on Improved SECOND Algorithm
    Zhang Ying
    Jiang Liangliang
    Zhang Dongbo
    Duan Wanlin
    Sun Yue
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (08)
  • [49] Multi-object Detection Algorithm Based on Point Cloud for Autonomous Driving Scenarios
    Tao, Le
    Wang, Hai
    Cai, Yingfeng
    Chen, Long
    Qiche Gongcheng/Automotive Engineering, 2024, 46 (07): : 1208 - 1218and1238
  • [50] Traffic Marking Extraction Algorithm Based on Image and Point Cloud Data
    Wu, Youping
    Mao, Yunlei
    IEEE ACCESS, 2024, 12 : 78328 - 78341