A Survey of the Multi-Sensor Fusion Object Detection Task in Autonomous Driving

被引:1
作者
Wang, Hai [1 ]
Liu, Junhao [1 ]
Dong, Haoran [1 ]
Shao, Zheng [1 ]
机构
[1] Jiangsu Univ, Sch Automot & Traff Engn, Zhenjiang 212013, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-sensor fusion; object detection; LiDAR; cameras; environmental perception;
D O I
10.3390/s25092794
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Multi-sensor fusion object detection is an advanced method that improves object recognition and tracking accuracy by integrating data from different types of sensors. As it can overcome the limitations of a single sensor in complex environments, the method has been widely applied in fields such as autonomous driving, intelligent monitoring, robot navigation, drone flight and so on. In the field of autonomous driving, multi-sensor fusion object detection has become a hot research topic. To further explore the future development trends of multi-sensor fusion object detection, we introduce the mainstream framework Transformer model of the multi-sensor fusion object detection algorithm, and we also provide a comprehensive summary of the feature fusion algorithms used in multi-sensor fusion object detection, specifically focusing on the fusion of camera and LiDAR data. This article provides an overview of feature fusion's development into feature-level fusion and proposal-level fusion, and it specifically reviews multiple related algorithms. We discuss the application of current multi-sensor object detection algorithms. In the future, with the continuous advancement of sensor technology and the development of artificial intelligence algorithms, multi-sensor fusion object detection will show great potential in more fields.
引用
收藏
页数:25
相关论文
共 120 条
[31]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[32]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[33]  
Grewal MS, 2015, KALMAN FILTERING: THEORY AND PRACTICE USING MATLAB(R), 4TH EDITION, P1
[34]   Real-Time Predictive Control of Path Following to Stabilize Autonomous Electric Vehicles Under Extreme Drive Conditions [J].
Guo, Ningyuan ;
Zhang, Xudong ;
Zou, Yuan .
AUTOMOTIVE INNOVATION, 2022, 5 (04) :453-470
[35]   Deep Multimodal Representation Learning: A Survey [J].
Guo, Wenzhong ;
Wang, Jianwen ;
Wang, Shiping .
IEEE ACCESS, 2019, 7 :63373-63394
[36]   Robust Object Detection in Challenging Weather Conditions [J].
Gupta, Himanshu ;
Kotlyar, Oleksandr ;
Andreasson, Henrik ;
Lilienthal, Achim J. .
2024 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION, WACV 2024, 2024, :7508-7517
[37]   Integration of a low-cost electronic nose and a voltammetric electronic tongue for red wines identification [J].
Han, Fangkai ;
Zhang, Dongjing ;
Aheto, Joshua H. ;
Feng, Fan ;
Duan, Tengfei .
FOOD SCIENCE & NUTRITION, 2020, 8 (08) :4330-4339
[38]   Towards Safe Autonomous Driving: Decision Making with Observation-Robust Reinforcement Learning [J].
He, Xiangkun ;
Lv, Chen .
AUTOMOTIVE INNOVATION, 2023, 6 (04) :509-520
[39]  
Hu CY, 2023, Arxiv, DOI arXiv:2309.05257
[40]  
Huang JJ, 2022, Arxiv, DOI arXiv:2203.17054