A Survey of the Multi-Sensor Fusion Object Detection Task in Autonomous Driving

被引:1
作者
Wang, Hai [1 ]
Liu, Junhao [1 ]
Dong, Haoran [1 ]
Shao, Zheng [1 ]
机构
[1] Jiangsu Univ, Sch Automot & Traff Engn, Zhenjiang 212013, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-sensor fusion; object detection; LiDAR; cameras; environmental perception;
D O I
10.3390/s25092794
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Multi-sensor fusion object detection is an advanced method that improves object recognition and tracking accuracy by integrating data from different types of sensors. As it can overcome the limitations of a single sensor in complex environments, the method has been widely applied in fields such as autonomous driving, intelligent monitoring, robot navigation, drone flight and so on. In the field of autonomous driving, multi-sensor fusion object detection has become a hot research topic. To further explore the future development trends of multi-sensor fusion object detection, we introduce the mainstream framework Transformer model of the multi-sensor fusion object detection algorithm, and we also provide a comprehensive summary of the feature fusion algorithms used in multi-sensor fusion object detection, specifically focusing on the fusion of camera and LiDAR data. This article provides an overview of feature fusion's development into feature-level fusion and proposal-level fusion, and it specifically reviews multiple related algorithms. We discuss the application of current multi-sensor object detection algorithms. In the future, with the continuous advancement of sensor technology and the development of artificial intelligence algorithms, multi-sensor fusion object detection will show great potential in more fields.
引用
收藏
页数:25
相关论文
共 120 条
[51]   Adaptive Sliding Mode Path Tracking Control of Unmanned Rice Transplanter [J].
Li, Jinyang ;
Shang, Zhijian ;
Li, Runfeng ;
Cui, Bingbo .
AGRICULTURE-BASEL, 2022, 12 (08)
[52]   Evaluating green tea quality based on multisensor data fusion combining hyperspectral imaging and olfactory visualization systems [J].
Li, Luqing ;
Xie, Shimeng ;
Ning, Jingming ;
Chen, Quansheng ;
Zhang, Zhengzhu .
JOURNAL OF THE SCIENCE OF FOOD AND AGRICULTURE, 2019, 99 (04) :1787-1794
[53]   Traffic flow prediction over muti-sensor data correlation with graph convolution network [J].
Li, Wei ;
Wang, Xin ;
Zhang, Yiwen ;
Wu, Qilin .
NEUROCOMPUTING, 2021, 427 :50-63
[54]  
Li Y., 2022, P IEEE CVF C COMP VI
[55]   Fully Sparse Fusion for 3D Object Detection [J].
Li, Yingyan ;
Fan, Lue ;
Liu, Yang ;
Huang, Zehao ;
Chen, Yuntao ;
Wang, Naiyan ;
Zhang, Zhaoxiang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (11) :7217-7231
[56]  
Liu Ajian, 2023, 2023 China Automation Congress (CAC), P7828, DOI 10.1109/CAC59555.2023.10450195
[57]   Development of Deep Learning-Based Variable Rate Agrochemical Spraying System for Targeted Weeds Control in Strawberry Crop [J].
Liu, Jizhan ;
Abbas, Irfan ;
Noor, Rana Shahzad .
AGRONOMY-BASEL, 2021, 11 (08)
[58]   An Ultrasonic Ridge-Tracking Method Based on Limiter Sliding Window Filter and Fuzzy Pure Pursuit Control for Ridge Transplanter [J].
Liu, Wei ;
Zhou, Jinhao ;
Liu, Yutong ;
Zhang, Tengfei ;
Yan, Meng ;
Chen, Ji ;
Zhou, Chunjian ;
Hu, Jianping ;
Chen, Xinxin .
AGRICULTURE-BASEL, 2024, 14 (10)
[59]  
Liu Yaopeng, 2021, 2021 IEEE International Conference on Data Science and Computer Application (ICDSCA), P397, DOI 10.1109/ICDSCA53499.2021.9649726
[60]   BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation [J].
Liu, Zhijian ;
Tang, Haotian ;
Amini, Alexander ;
Yang, Xinyu ;
Mao, Huizi ;
Rus, Daniela L. ;
Han, Song .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, :2774-2781