Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

被引:5
|
作者
Zhang, Xiucai [1 ]
He, Lei [1 ]
Chen, Junyi [1 ]
Wang, Baoyun [1 ]
Wang, Yuhai [1 ]
Zhou, Yuanle [1 ]
机构
[1] Jilin Univ, State Key Lab Automot Simulat & Control, Changchun 130022, Peoples R China
关键词
multimodal fusion; attention mechanism; 3D target detection; deep learning; REPRESENTATION;
D O I
10.3390/s23218732
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from the camera. For image feature extraction, the ResNet50 + FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and voxel fusion methods. After information fusion, the Coordinate and SimAM attention mechanisms extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm; the proposed algorithm improves the mAP value by 7.9% in the BEV view and 7.8% in the 3D view at IOU = 0.5 (cars) and IOU = 0.25 (pedestrians and cyclists). At IOU = 0.7 (cars) and IOU = 0.5 (pedestrians and cyclists), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] A salient object detection algorithm based on RGB-D images
    Song, Can
    Wu, Jin
    Deng, Huiping
    Zhu, Lei
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1692 - 1697
  • [22] Point-Level Fusion and Channel Attention for 3D Object Detection in Autonomous Driving
    Shen, Juntao
    Fang, Zheng
    Huang, Jin
    SENSORS, 2025, 25 (04)
  • [23] 3D object detection based on point cloud in automatic driving scene
    Li, Hai-Sheng
    Lu, Yan-Ling
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 13029 - 13044
  • [24] A LiDAR Multi-Object Detection Algorithm for Autonomous Driving
    Wang, Shuqi
    Chen, Meng
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [25] LXLv2: Enhanced LiDAR Excluded Lean 3D Object Detection with Fusion of 4D Radar and Camera
    Xiong, Weiyi
    Zou, Zean
    Zhao, Qiuchi
    He, Fengchun
    Zhu, Bing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (03): : 2862 - 2869
  • [26] 3D object detection based on point cloud in automatic driving scene
    Hai-Sheng Li
    Yan-Ling Lu
    Multimedia Tools and Applications, 2024, 83 : 13029 - 13044
  • [27] Efficient 3D Object Detection of Indoor Scenes Based on RGB-D Video Stream
    Miao Y.
    Chen J.
    Zhang X.
    Ma W.
    Sun S.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (07): : 1015 - 1025
  • [28] Radar Voxel Fusion for 3D Object Detection
    Nobis, Felix
    Shafiei, Ehsan
    Karle, Phillip
    Betz, Johannes
    Lienkamp, Markus
    APPLIED SCIENCES-BASEL, 2021, 11 (12):
  • [29] 3D point cloud object detection algorithm based on Transformer
    Liu M.
    Yang Q.
    Hu G.
    Guo Y.
    Zhang J.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2023, 41 (06): : 1190 - 1197
  • [30] Aerial LiDAR-based 3D Object Detection and Tracking for Traffic Monitoring
    Cherif, Baya
    Ghazzai, Hakim
    Alsharoa, Ahmad
    Besbes, Hichem
    Massoud, Yehia
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,