Adaptive multi-object tracking based on sensors fusion with confidence updating

被引:3
|
作者
Liu, Junting [1 ]
Liu, Deer [1 ]
Ji, Weizhen [2 ]
Cai, Chengfeng [1 ]
Liu, Zhen [1 ]
机构
[1] Jiangxi Univ Sci & Technol, Sch Civil & Surveying & Mapping Engn, Ganzhou 341400, Peoples R China
[2] Beijing Normal Univ, Fac Geog Sci, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
关键词
Sensors fusion; 3D multi-object tracking; Confidence; Adaptive factor;
D O I
10.1016/j.jag.2023.103577
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Multi-object tracking (MOT) systems typically rely on object detection results for tracking, so the accuracy of the MOT system is significantly affected by the error of the detector. Changes in error usually lead to unstable tracking. Regarding this problem, we proposed an adaptive MOT method based on detection confidence. At first, we use a simple data fusion method to combine the detection results of LiDAR and camera to reduce the large number of false detections. And then we used a factor based on confidence to adjust the estimating covariance matrix and measurement covariance matrix adaptively. The algorithm can judge which is more reliable between prediction and detection, and choose which is more important in the update step. Meanwhile, we set a factor based on confidence to control the search range in the data association module. Our method reduces the impact of detector error while ensuring accuracy and speed, and improves the robustness of the MOT algorithm. Through experiments conducted on the KITTI multi-object tracking dataset, our method has demonstrated significant advantages over state-of-the-art (SOTA) methods in terms of both accuracy and processing speed. The results of MOTA for 90.02% and FPS for 262.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Robust Online Multi-Object Tracking based on Tracklet Confidence and Online Discriminative Appearance Learning
    Bae, Seung-Hwan
    Yoon, Kuk-Jin
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1218 - 1225
  • [32] AIPT: Adaptive information perception for online multi-object tracking
    Zhang, Yukuan
    Xie, Housheng
    Jia, Yunhua
    Meng, Jingrui
    Sang, Meng
    Qiu, Junhui
    Zhao, Shan
    Yang, Yang
    KNOWLEDGE-BASED SYSTEMS, 2024, 285
  • [33] A novel multi-object tracking algorithm based on RJMCMC with RGB and depth information fusion
    Faculty of Electronics Information and Electrical Engineering, Dalian University of Technology, Dalian, China
    不详
    不详
    Guangdianzi Jiguang, 7 (1342-1348):
  • [34] Fusion of local and global detectors for PHD filter-based multi-object tracking
    Yoon J.H.
    Hwang Y.
    Choi B.
    Yoon K.-J.
    Journal of Institute of Control, Robotics and Systems, 2016, 22 (09) : 773 - 777
  • [35] Multi-object trajectory tracking
    Han, Mei
    Xu, Wei
    Tao, Hai
    Gong, Yihong
    MACHINE VISION AND APPLICATIONS, 2007, 18 (3-4) : 221 - 232
  • [36] 3D Multi-Object Tracking Based on Radar-Camera Fusion
    Lin, Zihao
    Hu, Jianming
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2502 - 2507
  • [37] Multi-object tracking in video
    Agbinya, JI
    Rees, D
    REAL-TIME IMAGING, 1999, 5 (05) : 295 - 304
  • [38] Referring Multi-Object Tracking
    Wu, Dongming
    Han, Wencheng
    Wang, Tiancai
    Dong, Xingping
    Zhang, Xiangyu
    Shen, Jianbing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14633 - 14642
  • [39] Data Fusion-Based Multi-Object Tracking for Unconstrained Visual Sensor Networks
    Jiang, Xiaoyan
    Fang, Zhijun
    Xiong, Neal N.
    Gao, Yongbin
    Huang, Bo
    Zhang, Juan
    Yu, Lei
    Harrington, Patrick
    IEEE ACCESS, 2018, 6 : 13716 - 13728
  • [40] Multi-Object Tracking in the Dark
    Wang, Xinzhe
    Ma, Kang
    Liu, Qiankun
    Zou, Yunhao
    Fu, Ying
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 382 - 392