Research on Vehicle Safety Based on Multi-Sensor Feature Fusion for Autonomous Driving Task

被引:0
作者
Su, Yang [1 ]
Shi, Xianrang [1 ]
Song, Tinglun [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Energy & Power Engn, Nanjing 210016, Peoples R China
[2] Chery Automobile Co Ltd, Inst Adv Technol, Wuhu 241009, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2025年 / 83卷 / 03期
关键词
Multi-sensor fusion; autonomous driving; feature selection; attention mechanism; reinforcement learning;
D O I
10.32604/cmc.2025.064036
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving. This study aims to enhance the learning efficiency of multi-sensor feature fusion in autonomous driving tasks, thereby improving the safety and responsiveness of the system. To achieve this goal, we propose an innovative multi-sensor feature fusion model that integrates three distinct modalities: visual, radar, and lidar data. The model optimizes the feature fusion process through the introduction of two novel mechanisms: Sparse Channel Pooling (SCP) and Residual Triplet-Attention (RTA). Firstly, the SCP mechanism enables the model to adaptively filter out salient feature channels while eliminating the interference of redundant features. This enhances the model's emphasis on critical features essential for decision-making and strengthens its robustness to environmental variability. Secondly, the RTA mechanism addresses the issue of feature misalignment across different modalities by effectively aligning key cross-modal features. This alignment reduces the computational overhead associated with redundant features and enhances the overall efficiency of the system. Furthermore, this study incorporates a reinforcement learning module designed to optimize strategies within a continuous action space. By integrating this module with the feature fusion learning process, the entire system is capable of learning efficient driving strategies in an end-to-end manner within the CARLA autonomous driving simulator. Experimental results demonstrate that the proposed model significantly enhances the perception and decision-making accuracy of the autonomous driving system in complex traffic scenarios while maintaining real-time responsiveness. This work provides a novel perspective and technical pathway for the application of multi-sensor data fusion in autonomous driving.
引用
收藏
页码:5831 / 5848
页数:18
相关论文
共 35 条
[1]   RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Driving [J].
Ando, Angelika ;
Gidaris, Spyros ;
Bursuc, Andrei ;
Puy, Gilles ;
Boulch, Alexandre ;
Marlet, Renaud .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :5240-5250
[2]   On circular traffic sign detection and recognition [J].
Berkaya, Selcan Kaplan ;
Gunduz, Huseyin ;
Ozsen, Ozgur ;
Akinlar, Cuneyt ;
Gunal, Serkan .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 48 :67-75
[3]   YOLOv4-5D: An Effective and Efficient Object Detector for Autonomous Driving [J].
Cai, Yingfeng ;
Luan, Tianyu ;
Gao, Hongbo ;
Wang, Hai ;
Chen, Long ;
Li, Yicheng ;
Sotelo, Miguel Angel ;
Li, Zhixiong .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[4]   MCS-YOLO: A Multiscale Object Detection Method for Autonomous Driving Road Environment Recognition [J].
Cao, Yining ;
Li, Chao ;
Peng, Yakun ;
Ru, Huiying .
IEEE ACCESS, 2023, 11 :22342-22354
[5]   Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning [J].
Chen, Jianyu ;
Li, Shengbo Eben ;
Tomizuka, Masayoshi .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) :5068-5078
[6]   Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review [J].
Cui, Yaodong ;
Chen, Ren ;
Chu, Wenbo ;
Chen, Long ;
Tian, Daxin ;
Li, Ying ;
Cao, Dongpu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) :722-739
[7]  
Gao M, 2021, INT C CONTR AUTOMAT, P1360, DOI 10.23919/ICCAS52745.2021.9649939
[8]   A survey of deep learning techniques for autonomous driving [J].
Grigorescu, Sorin ;
Trasnea, Bogdan ;
Cocias, Tiberiu ;
Macesanu, Gigel .
JOURNAL OF FIELD ROBOTICS, 2020, 37 (03) :362-386
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269