Effective Local and Global Search for Fast Long-Term Tracking

被引:16
作者
Zhao, Haojie [1 ]
Yan, Bin [1 ]
Wang, Dong [1 ]
Qian, Xuesheng [2 ]
Yang, Xiaoyun [3 ]
Lu, Huchuan [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116023, Ganjingzi, Peoples R China
[2] CAS Intellicloud Ltd, Shanghai 202150, Peoples R China
[3] Remark Holdings, London SE1 9PD, England
基金
中国国家自然科学基金;
关键词
Visual object tracking; long-term tracking; global re-detection; OBJECT TRACKING;
D O I
10.1109/TPAMI.2022.3153645
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared with short-term tracking, long-term tracking remains a challenging task that usually requires the tracking algorithm to track targets within a local region and re-detect targets over the entire image. However, few works have been done and their performances have also been limited. In this paper, we present a novel robust and real-time long-term tracking framework based on the proposed local search module and re-detection module. The local search module consists of an effective bounding box regressor to generate a series of candidate proposals and a target verifier to infer the optimal candidate with its confidence score. For local search, we design a long short-term updated scheme to improve the target verifier. The verification capability of the tracker can be improved by using several templates updated at different times. Based on the verification scores, our tracker determines whether the tracked object is present or absent and then chooses the tracking strategies of local or global search, respectively, in the next frame. For global re-detection, we develop a novel re-detection module that can estimate the target position and target size for a given base tracker. We conduct a series of experiments to demonstrate that this module can be flexibly integrated into many other tracking algorithms for long-term tracking and that it can improve long-term tracking performance effectively. Numerous experiments and discussions are conducted on several popular tracking datasets, including VOT, OxUvA, TLP, and LaSOT. The experimental results demonstrate that the proposed tracker achieves satisfactory performance with a real-time speed. Code is available at https://github.com/difhnp/ELGLT.
引用
收藏
页码:460 / 474
页数:15
相关论文
共 50 条
[41]   Support vector correlation filter with long-term tracking [J].
Zhongpei Wang ;
Hao Wang ;
Baofu Fang ;
Chengjun Xie .
Signal, Image and Video Processing, 2018, 12 :1541-1549
[42]   Hierarchical Convolutional Features for Long-Term Correlation Tracking [J].
Chen, Huizhi ;
Fan, Baojie .
COMPUTER VISION, PT III, 2017, 773 :677-686
[43]   Long-term adaptive tracking via complementary trackers [J].
Dai, Weicong ;
Jin, Longxu ;
Li, Guoning .
IET IMAGE PROCESSING, 2019, 13 (09) :1569-1577
[44]   Long-Term Object Tracking Based On Feature Fusion [J].
Ge Baoyi ;
Zuo Xianzhang ;
Hu Yongjiang .
ACTA OPTICA SINICA, 2018, 38 (11)
[45]   Robust long-term correlation tracking with multiple models [J].
Wang, Fei ;
Liu, Guixi ;
Zhang, Haoyang ;
Hao, Zhaohui .
IET IMAGE PROCESSING, 2019, 13 (07) :1056-1065
[46]   Local Semantic Siamese Networks for Fast Tracking [J].
Liang, Zhiyuan ;
Shen, Jianbing .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3351-3364
[47]   Learning Multifeature Correlation Filter and Saliency Redetection for Long-Term Object Tracking [J].
Liu, Liqiang ;
Feng, Tiantian ;
Fu, Yanfang .
SYMMETRY-BASEL, 2022, 14 (05)
[48]   Real-Time Long-Term Tracking With Prediction-Detection-Correction [J].
Liang, Ningxin ;
Wu, Guile ;
Kang, Wenxiong ;
Wang, Zhiyong ;
Feng, David Dagan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2289-2302
[49]   Survey on Deep-Learning-Based Long-Term Object Tracking Algorithms [J].
Liang, Yitao ;
Han, Yongbo ;
Li, Lei .
Computer Engineering and Applications, 2024, 59 (04) :1-17
[50]   Robust long-term correlation tracking using convolutional features and detection proposals [J].
Lin, Bin ;
Li, Ying ;
Xue, Xizhe ;
Chan, Jonathan Cheung-Wai .
NEUROCOMPUTING, 2018, 317 :137-148