Correlation Filters for UAV Online Tracking Based on Complementary Appearance Model and Reversibility Reasoning

被引:3
作者
Wang, Biao [1 ]
Li, Wenling [1 ]
Zhang, Bin [2 ]
Liu, Yang [1 ]
Du, Junping [3 ]
机构
[1] Beihang Univ BUAA, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Information filters; Autonomous aerial vehicles; Correlation; Training; Real-time systems; Computational modeling; Correlation filter (CF); unmanned aerial vehicle (UAV); online object tracking; complementary appearance model (CAM); reversibility reasoning; NETWORK; ROBUST;
D O I
10.1109/TCSVT.2023.3325672
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Correlation filter (CF)-based approaches have been widely applied in online object tracking tasks for unmanned aerial vehicles (UAVs) due to their high computational efficiency and low memory consumption. One of the key steps is to perform correlation operations between the appearance model (AM) and the filter. However, as the difficulty in controlling the learning rate of the AM, most existing trackers are prone to causing degradation. In this paper, we propose a novel complementary AM (CAM) consisting of a primary model (PM) and a secondary model (SM). Specifically, the learning rates of the PM and SM are approximately complementary, allowing the CAM to consider both past and current information. Moreover, in order to take full advantage of historical information, a CAM-based reversibility reasoning approach is proposed for CF training. It can robustly handle the variations in object appearance. Then we further create a deep tracker by fusing convolutional features which demonstrates more outstanding performance. We also embed the CAM into two advanced trackers to validate the scalability of the CAM. Comprehensive experiments on six challenging UAV tracking benchmarks have indicated the superiority of our method compared to other 36 state-of-the-art CPU- and GPU-based trackers, with a speed of 45 FPS running on a cheap CPU.
引用
收藏
页码:3983 / 3997
页数:15
相关论文
共 74 条
[1]  
[Anonymous], 2014, P BRIT MACHINE VISI
[2]   Staple: Complementary Learners for Real-Time Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Golodetz, Stuart ;
Miksik, Ondrej ;
Torr, Philip H. S. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1401-1409
[3]  
Bolme DS, 2010, PROC CVPR IEEE, P2544, DOI 10.1109/CVPR.2010.5539960
[4]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[5]   Bayesian Correlation Filter Learning With Gaussian Scale Mixture Model for Visual Tracking [J].
Cao, Yuan ;
Shi, Guangming ;
Zhang, Tianzhu ;
Dong, Weisheng ;
Wu, Jinjian ;
Xie, Xuemei ;
Li, Xin .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) :3085-3098
[6]   Towards Real-World Visual Tracking With Temporal Contexts [J].
Cao, Ziang ;
Huang, Ziyuan ;
Pan, Liang ;
Zhang, Shiwei ;
Liu, Ziwei ;
Fu, Changhong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) :15834-15849
[7]   TCTrack: Temporal Contexts for Aerial Tracking [J].
Cao, Ziang ;
Huang, Ziyuan ;
Pan, Liang ;
Zhang, Shiwei ;
Liu, Ziwei ;
Fu, Changhong .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :14778-14788
[8]   HiFT: Hierarchical Feature Transformer for Aerial Tracking [J].
Cao, Ziang ;
Fu, Changhong ;
Ye, Junjie ;
Li, Bowen ;
Li, Yiming .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :15437-15446
[9]  
Cen MB, 2018, IEEE IMAGE PROC, P3718, DOI 10.1109/ICIP.2018.8451102
[10]  
Chatfield K, 2014, Arxiv, DOI arXiv:1405.3531