Multi-object tracking algorithm based on interactive attention network and adaptive trajectory reconnection

被引:7
|
作者
Ma, Sugang [1 ,4 ]
Duan, Shuaipeng [1 ]
Hou, Zhiqiang [1 ]
Yu, Wangsheng [2 ]
Pu, Lei [3 ]
Zhao, Xiangmo [4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Peoples R China
[2] Air Force Engn Univ, Sch Informat & Nav, Xian 710077, Peoples R China
[3] Rocket Force Engn Univ, Sch Operat Support, Xian 710025, Peoples R China
[4] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
关键词
Multi-object tracking; Interactive attention network; Camera motion compensation; Cost matrix; Adaptive trajectory reconnection;
D O I
10.1016/j.eswa.2024.123581
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-object tracking (MOT) detects multiple targets in an image and assigns a unique identifier to each target. However, challenges such as rapid motion, occlusion, and camera motion in the tracking scene may lead to identity switches (IDs) and missing trajectory problems, which degrade the performance of the tracker. To address these issues, this paper presents an MOT algorithm based on an interactive attention network and adaptive trajectory reconnection. First, an interactive attention network was created to learn the features for two different tasks of detection and tracking to alleviate feature conflicts in order to extract sufficient feature information. A new cost matrix was then designed to fuse the motion and feature information, thereby reducing the number of IDs. Meanwhile, the extreme gradient boosting reconnection module was used to achieve adaptive trajectory reconnection and reduce missing trajectories. The proposed algorithm achieved 61.5 % and 55.4 % HOTA using the standard MOT17 and MOT20 datasets, respectively. In comparison to FairMOT, our algorithm showcased notable enhancements of 3% and 1.6% on these datasets. Furthermore, when compared to state-ofthe-art algorithms, the proposed algorithm demonstrated superior tracking performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Multi-object tracking algorithm based on multi-stage association
    Huo X.
    Gai S.
    Hong R.
    Zhou W.
    Da F.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (11): : 205 - 214
  • [22] Height estimation algorithm based on visual multi-object tracking
    School of Information and Communication Engineering, Dalian University of Technology, Dalian
    Liaoning
    116024, China
    不详
    Liaoning
    116600, China
    Tien Tzu Hsueh Pao, 3 (591-596):
  • [23] Object Tracking Algorithm Based on Multi-Stream Attention Siamese Network
    Yu L.
    Tian L.
    Du Q.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (12): : 30 - 40
  • [24] Multi-Object Tracking with Adaptive Cost Matrix
    Wang, Mingyan
    Li, Bozheng
    Jiang, Haoran
    Zhang, Junjie
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [25] Multi-object tracking based on attention networks for Smart City system
    Zhou, Xiaolong
    Jia, Yangwei
    Bai, Cong
    Zhu, Haiping
    Chan, Sixian
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2022, 52
  • [26] Heterogeneous Multi-object Trajectory Prediction Method Based on Hierarchical Graph Attention
    Hu Q.
    Cai Y.
    Wang H.
    Chen L.
    Dong Z.
    Liu Q.
    Qiche Gongcheng/Automotive Engineering, 2023, 45 (08): : 1448 - 1456
  • [27] Attention mechanics for improving online Multi-Object Tracking
    Minh Chuong Dang
    Duc Dung Nguyen
    2022 ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING (CACML 2022), 2022, : 200 - 205
  • [28] Deep Network Flow for Multi-Object Tracking
    Schulter, Samuel
    Vernaza, Paul
    Choi, Wongun
    Chandraker, Manmohan
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2730 - 2739
  • [29] Multi-object tracking with hard-soft attention network and group-based cost minimization
    Liu, Yating
    Li, Xuesong
    Bai, Tianxiang
    Wang, Kunfeng
    Wang, Fei-Yue
    NEUROCOMPUTING, 2021, 447 : 80 - 91
  • [30] Adaptive multi-object tracking based on sensors fusion with confidence updating
    Liu, Junting
    Liu, Deer
    Ji, Weizhen
    Cai, Chengfeng
    Liu, Zhen
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 125