Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

被引:5
|
作者
Zhang, Xiucai [1 ]
He, Lei [1 ]
Chen, Junyi [1 ]
Wang, Baoyun [1 ]
Wang, Yuhai [1 ]
Zhou, Yuanle [1 ]
机构
[1] Jilin Univ, State Key Lab Automot Simulat & Control, Changchun 130022, Peoples R China
关键词
multimodal fusion; attention mechanism; 3D target detection; deep learning; REPRESENTATION;
D O I
10.3390/s23218732
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a multimodal fusion 3D target detection algorithm based on the attention mechanism to improve the performance of 3D target detection. The algorithm utilizes point cloud data and information from the camera. For image feature extraction, the ResNet50 + FPN architecture extracts features at four levels. Point cloud feature extraction employs the voxel method and FCN to extract point and voxel features. The fusion of image and point cloud features is achieved through regional point fusion and voxel fusion methods. After information fusion, the Coordinate and SimAM attention mechanisms extract fusion features at a deep level. The algorithm's performance is evaluated using the DAIR-V2X dataset. The results show that compared to the Part-A2 algorithm; the proposed algorithm improves the mAP value by 7.9% in the BEV view and 7.8% in the 3D view at IOU = 0.5 (cars) and IOU = 0.25 (pedestrians and cyclists). At IOU = 0.7 (cars) and IOU = 0.5 (pedestrians and cyclists), the mAP value of the SECOND algorithm is improved by 5.4% in the BEV view and 4.3% in the 3D view, compared to other comparison algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] LiDAR-Based Intensity-Aware Outdoor 3D Object Detection
    Naich, Ammar Yasir
    Carrion, Jesus Requena
    SENSORS, 2024, 24 (09)
  • [32] DLFusion: Painting-Depth Augmenting-LiDAR for Multimodal Fusion 3D Object Detection
    Wang, Junyin
    Du, Chenghu
    Li, Hui
    Xiong, Shengwu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3765 - 3776
  • [33] 3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images
    Qin Chao
    Wang Yafei
    Zhang Yuchao
    Yin Chengliang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)
  • [34] 3D Object Detection for Autonomous Driving: A Comprehensive Survey
    Mao, Jiageng
    Shi, Shaoshuai
    Wang, Xiaogang
    Li, Hongsheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (08) : 1909 - 1963
  • [35] 3D Object Detection for Autonomous Driving: A Comprehensive Survey
    Jiageng Mao
    Shaoshuai Shi
    Xiaogang Wang
    Hongsheng Li
    International Journal of Computer Vision, 2023, 131 : 1909 - 1963
  • [36] 3D Object Detection for Autonomous Driving: A Practical Survey
    Ramajo-Ballester, Alvaro
    de la Escalera Hueso, Arturo
    Armingol Moreno, Jose Maria
    PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON VEHICLE TECHNOLOGY AND INTELLIGENT TRANSPORT SYSTEMS, VEHITS 2023, 2023, : 64 - 73
  • [37] 3D object detection algorithms in autonomous driving: A review
    Ren K.-Y.
    Gu M.-Y.
    Yuan Z.-Q.
    Yuan S.
    Kongzhi yu Juece/Control and Decision, 2023, 38 (04): : 865 - 889
  • [38] Expandable YOLO: 3D Object Detection from RGB-D Images
    Takahashi, Masahiro
    Ji, Yonghoon
    Umeda, Kazunori
    Moro, Alessandro
    2020 21ST INTERNATIONAL CONFERENCE ON RESEARCH AND EDUCATION IN MECHATRONICS (REM), 2020,
  • [39] Fusion information enhanced method based on transformer for 3D object detection
    Jin Y.
    Tao C.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (12): : 297 - 306
  • [40] CaLiJD: Camera and LiDAR Joint Contender for 3D Object Detection
    Lyu, Jiahang
    Qi, Yongze
    You, Suilian
    Meng, Jin
    Meng, Xin
    Kodagoda, Sarath
    Wang, Shifeng
    REMOTE SENSING, 2024, 16 (23)