Multiple Object Tracking of Drone Videos by a Temporal-Association Network with Separated-Tasks Structure

被引:10
|
作者
Lin, Yeneng [1 ]
Wang, Mengmeng [1 ]
Chen, Wenzhou [1 ]
Gao, Wang [2 ]
Li, Lei [2 ]
Liu, Yong [1 ]
机构
[1] Zhejiang Univ, Inst Cyber Syst & Control, Hangzhou 310027, Peoples R China
[2] Sci & Technol Complex Syst Control & Intelligent, Beijing 100191, Peoples R China
关键词
deep learning; multi-object tracking; data association; object detection; temporal information; remote sensing data; video sequence; COMPUTER VISION;
D O I
10.3390/rs14163862
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The task of multi-object tracking via deep learning methods for UAV videos has become an important research direction. However, with some current multiple object tracking methods, the relationship between object detection and tracking is not well handled, and decisions on how to make good use of temporal information can affect tracking performance as well. To improve the performance of multi-object tracking, this paper proposes an improved multiple object tracking model based on FairMOT. The proposed model contains a structure to separate the detection and ReID heads to decrease the influence between every function head. Additionally, we develop a temporal embedding structure to strengthen the representational ability of the model. By combing the temporal-association structure and separating different function heads, the model's performance in object detection and tracking tasks is improved, which has been verified on the VisDrone2019 dataset. Compared with the original method, the proposed model improves MOTA by 4.9% and MOTP by 1.2% and has better tracking performance than the models such as SORT and HDHNet on the UAV video dataset.
引用
收藏
页数:19
相关论文
共 14 条
  • [1] Multiple Object Tracking in Drone Aerial Videos by a Holistic Transformer and Multiple Feature Trajectory Matching Pattern
    Yuan, Yubin
    Wu, Yiquan
    Zhao, Langyue
    Pang, Yaxuan
    Liu, Yuqi
    DRONES, 2024, 8 (08)
  • [2] Multiple Object Association Incorporating Object Tracking, Depth, and Velocity Analysis on 2D Videos
    Pogaru, Srikar
    Bose, Archit
    Elliott, David
    O'Keefe, John
    SOUTHEASTCON 2021, 2021, : 289 - 294
  • [3] Multiple object detection and tracking from drone videos based on GM-YOLO and multi-tracker
    Yuan, Yubin
    Wu, Yiquan
    Zhao, Langyue
    Chen, Huixian
    Zhang, Yao
    IMAGE AND VISION COMPUTING, 2024, 143
  • [4] MULTIPLE OBJECT TRACKING BY HIERARCHICAL ASSOCIATION OF SPATIO-TEMPORAL DATA
    Beleznai, Csaba
    Schreiber, David
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 41 - 44
  • [5] Multiple Cues association for Multiple Object Tracking based on Convolutional Neural Network
    Hu, Ronghua
    Bouindour, Samir
    Snoussi, Hichem
    Cherouat, Abel
    Chahla, Charbel
    2019 IEEE SECOND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND KNOWLEDGE ENGINEERING (AIKE), 2019, : 117 - 122
  • [6] Temporal-Spatial Feature Interaction Network for Multi-Drone Multi-Object Tracking
    Wu, Han
    Sun, Hao
    Ji, Kefeng
    Kuang, Gangyao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (02) : 1165 - 1179
  • [7] Object Tracking in Satellite Videos: A Spatial-Temporal Regularized Correlation Filter Tracking Method With Interacting Multiple Model
    Li, Yangfan
    Bian, Chunjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] MASK GUIDED SPATIAL-TEMPORAL FUSION NETWORK FOR MULTIPLE OBJECT TRACKING
    Zhao, Shuangye
    Wu, Yubin
    Wang, Shuai
    Ke, Wei
    Sheng, Hao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3231 - 3235
  • [9] Object Tracking in Satellite Videos Based on Siamese Network With Multidimensional Information-Aware and Temporal Motion Compensation
    Nie, Yidan
    Bian, Chunjiang
    Li, Ligang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] FAANet: feature-aligned attention network for real-time multiple object tracking in UAV videos
    梁振起
    王景石
    肖刚
    曾柳
    Chinese Optics Letters, 2022, 20 (08) : 10 - 15