Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

被引:5
作者
Zhang, Xiucai [1 ]
He, Lei [1 ]
Chen, Junyi [1 ]
Wang, Baoyun [1 ]
Wang, Yuhai [1 ]
Zhou, Yuanle [1 ]
机构
[1] Jilin Univ, State Key Lab Automot Simulat & Control, Changchun 130022, Peoples R China
关键词
multimodal fusion; attention mechanism; 3D target detection; deep learning; REPRESENTATION;
D O I
10.3390/s23218732
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from the camera. For image feature extraction, the ResNet50 + FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and voxel fusion methods. After information fusion, the Coordinate and SimAM attention mechanisms extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm; the proposed algorithm improves the mAP value by 7.9% in the BEV view and 7.8% in the 3D view at IOU = 0.5 (cars) and IOU = 0.25 (pedestrians and cyclists). At IOU = 0.7 (cars) and IOU = 0.5 (pedestrians and cyclists), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] 3D Flash LiDAR Object Detection and Tracking on Edge Hardware
    Lompado, Art
    Carvalho, Daniel R. M.
    Brown, Jarrod P.
    IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE, NAECON 2024, 2024, : 25 - 29
  • [42] End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Clouds
    Zhou, Yin
    Sun, Pei
    Zhang, Yu
    Anguelov, Dragomir
    Gao, Jiyang
    Ouyang, Tom
    Guo, James
    Ngiam, Jiquan
    Vasudevan, Vijay
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [43] MSGFusion: Muti-scale Semantic Guided LiDAR-Camera Fusion for 3D Object Detection
    Zhu, Huming
    Xue, Yiyu
    Cheng, Xinyue
    Hou, Biao
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [44] Infrastructure 3D Target Detection Based on Multi-Mode Fusion for Intelligent and Connected Vehicles
    Zhang, Xiucai
    He, Lei
    Lv, Rui
    Jin, Changcheng
    Wang, Yuhai
    IEEE ACCESS, 2023, 11 : 72803 - 72812
  • [45] 3D Object Detection Algorithm Based on Improved YOLOv5
    Sheng Xueqing
    Li Shaobin
    Qu Jinyan
    Liu Liu
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (18)
  • [46] An improved dense-to-sparse cross-modal fusion network for 3D object detection in RGB-D images
    Chen, Yan
    Ni, Jianjun
    Tang, Guangyi
    Cao, Weidong
    Yang, Simon X.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 12159 - 12184
  • [47] 3D Object Detection for Self-Driving Vehicles Enhanced by Object Velocity
    Alexandrino, Leandro
    Olyaei, Hadi Z.
    Albuquerque, Andre
    Georgieva, Petia
    Drummond, Miguel V.
    IEEE ACCESS, 2024, 12 : 8220 - 8229
  • [48] An improved dense-to-sparse cross-modal fusion network for 3D object detection in RGB-D images
    Yan Chen
    Jianjun Ni
    Guangyi Tang
    Weidong Cao
    Simon X. Yang
    Multimedia Tools and Applications, 2024, 83 : 12159 - 12184
  • [49] A Survey on 3D Object Detection Methods for Autonomous Driving Applications
    Arnold, Eduardo
    Al-Jarrah, Omar Y.
    Dianati, Mehrdad
    Fallah, Saber
    Oxtoby, David
    Mouzakitis, Alex
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (10) : 3782 - 3795
  • [50] A Review of 3D Object Detection for Autonomous Driving of Electric Vehicles
    Dai, Deyun
    Chen, Zonghai
    Bao, Peng
    Wang, Jikai
    WORLD ELECTRIC VEHICLE JOURNAL, 2021, 12 (03)