Effective Local and Global Search for Fast Long-Term Tracking

被引:16
作者
Zhao, Haojie [1 ]
Yan, Bin [1 ]
Wang, Dong [1 ]
Qian, Xuesheng [2 ]
Yang, Xiaoyun [3 ]
Lu, Huchuan [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116023, Ganjingzi, Peoples R China
[2] CAS Intellicloud Ltd, Shanghai 202150, Peoples R China
[3] Remark Holdings, London SE1 9PD, England
基金
中国国家自然科学基金;
关键词
Visual object tracking; long-term tracking; global re-detection; OBJECT TRACKING;
D O I
10.1109/TPAMI.2022.3153645
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared with short-term tracking, long-term tracking remains a challenging task that usually requires the tracking algorithm to track targets within a local region and re-detect targets over the entire image. However, few works have been done and their performances have also been limited. In this paper, we present a novel robust and real-time long-term tracking framework based on the proposed local search module and re-detection module. The local search module consists of an effective bounding box regressor to generate a series of candidate proposals and a target verifier to infer the optimal candidate with its confidence score. For local search, we design a long short-term updated scheme to improve the target verifier. The verification capability of the tracker can be improved by using several templates updated at different times. Based on the verification scores, our tracker determines whether the tracked object is present or absent and then chooses the tracking strategies of local or global search, respectively, in the next frame. For global re-detection, we develop a novel re-detection module that can estimate the target position and target size for a given base tracker. We conduct a series of experiments to demonstrate that this module can be flexibly integrated into many other tracking algorithms for long-term tracking and that it can improve long-term tracking performance effectively. Numerous experiments and discussions are conducted on several popular tracking datasets, including VOT, OxUvA, TLP, and LaSOT. The experimental results demonstrate that the proposed tracker achieves satisfactory performance with a real-time speed. Code is available at https://github.com/difhnp/ELGLT.
引用
收藏
页码:460 / 474
页数:15
相关论文
共 50 条
[21]   Multistage Analysis for Long-term Tracking [J].
Bai Lizhi ;
Zhang Liyan .
TWELFTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2020), 2021, 11720
[22]   Long-Term Object Tracking Based on Model Updating and Fast Re-Detection [J].
Shen Yuling ;
Wu Zhongdong ;
Zhao Rujin ;
Wu Xu ;
Yan Kun ;
Ma Yuebo .
ACTA OPTICA SINICA, 2020, 40 (03)
[23]   Spatial-Temporal Aware Long-Term Object Tracking [J].
Zhang, Wei ;
Kang, Baosheng ;
Zhang, Shunli .
IEEE ACCESS, 2020, 8 :71662-71684
[24]   Long-term visual tracking based on adaptive correlation filters [J].
Wang, Zhongmin ;
Zhang, Futao ;
Chen, Yanping ;
Ma, Sugang .
JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (05)
[25]   Long-term real time object tracking based on multi-scale local correlation filtering and global re-detection [J].
Zhao, Qi ;
Zhang, Boxue ;
Feng, Wenquan ;
Du, Zhiying ;
Zhang, Hong ;
Sun, Daniel .
COMPUTING, 2020, 102 (06) :1487-1501
[26]   Long-term real time object tracking based on multi-scale local correlation filtering and global re-detection [J].
Qi Zhao ;
Boxue Zhang ;
Wenquan Feng ;
Zhiying Du ;
Hong Zhang ;
Daniel Sun .
Computing, 2020, 102 :1487-1501
[27]   Multi-template global re-detection based on Gumbel-Softmax in long-term visual tracking [J].
Hou, Zhiqiang ;
Ma, Jingyuan ;
Yu, Wangsheng ;
Yang, Zhilong ;
Ma, Sugang ;
Fan, Jiulun .
APPLIED INTELLIGENCE, 2023, 53 (18) :20874-20890
[28]   A Robust Approach for Long-Term Hand Tracking [J].
Aziz, Muhammad Ali Abdul ;
Niu, Jianwei ;
Zhao, Xiaoke .
2015 12TH INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGY (IBCAST), 2015, :210-217
[29]   Long-term tracking with transformer and template update [J].
Hongying Zhang ;
Xiaowen Peng ;
Xuyong Wang .
EURASIP Journal on Advances in Signal Processing, 2022
[30]   Long-term tracking with transformer and template update [J].
Zhang, Hongying ;
Peng, Xiaowen ;
Wang, Xuyong .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2022, 2022 (01)