Correlation Filters for UAV Online Tracking Based on Complementary Appearance Model and Reversibility Reasoning

被引:3
作者
Wang, Biao [1 ]
Li, Wenling [1 ]
Zhang, Bin [2 ]
Liu, Yang [1 ]
Du, Junping [3 ]
机构
[1] Beihang Univ BUAA, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Information filters; Autonomous aerial vehicles; Correlation; Training; Real-time systems; Computational modeling; Correlation filter (CF); unmanned aerial vehicle (UAV); online object tracking; complementary appearance model (CAM); reversibility reasoning; NETWORK; ROBUST;
D O I
10.1109/TCSVT.2023.3325672
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Correlation filter (CF)-based approaches have been widely applied in online object tracking tasks for unmanned aerial vehicles (UAVs) due to their high computational efficiency and low memory consumption. One of the key steps is to perform correlation operations between the appearance model (AM) and the filter. However, as the difficulty in controlling the learning rate of the AM, most existing trackers are prone to causing degradation. In this paper, we propose a novel complementary AM (CAM) consisting of a primary model (PM) and a secondary model (SM). Specifically, the learning rates of the PM and SM are approximately complementary, allowing the CAM to consider both past and current information. Moreover, in order to take full advantage of historical information, a CAM-based reversibility reasoning approach is proposed for CF training. It can robustly handle the variations in object appearance. Then we further create a deep tracker by fusing convolutional features which demonstrates more outstanding performance. We also embed the CAM into two advanced trackers to validate the scalability of the CAM. Comprehensive experiments on six challenging UAV tracking benchmarks have indicated the superiority of our method compared to other 36 state-of-the-art CPU- and GPU-based trackers, with a speed of 45 FPS running on a cheap CPU.
引用
收藏
页码:3983 / 3997
页数:15
相关论文
共 74 条
[61]   Learning Low-Rank and Sparse Discriminative Correlation Filters for Coarse-to-Fine Visual Object Tracking [J].
Xu, Tianyang ;
Feng, Zhen-Hua ;
Wu, Xiao-Jun ;
Kittler, Josef .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (10) :3727-3739
[62]  
Xu YD, 2020, AAAI CONF ARTIF INTE, V34, P12549
[63]   LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search [J].
Yan, Bin ;
Peng, Houwen ;
Wu, Kan ;
Wang, Dong ;
Fu, Jianlong ;
Lu, Huchuan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15175-15184
[64]   Multi-Regularized Correlation Filter for UAV Tracking and Self-Localization [J].
Ye, Junjie ;
Fu, Changhong ;
Lin, Fuling ;
Ding, Fangqiang ;
An, Shan ;
Lu, Geng .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (06) :6004-6014
[65]   Aligned Spatial-Temporal Memory Network for Thermal Infrared Target Tracking [J].
Yuan, Di ;
Shu, Xiu ;
Liu, Qiao ;
He, Zhenyu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (03) :1224-1228
[66]   Active Learning for Deep Visual Tracking [J].
Yuan, Di ;
Chang, Xiaojun ;
Liu, Qiao ;
Yang, Yi ;
Wang, Dehua ;
Shu, Minglei ;
He, Zhenyu ;
Shi, Guangming .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) :13284-13296
[67]   Learning Adaptive Spatial-Temporal Context-Aware Correlation Filters for UAV Tracking [J].
Yuan, Di ;
Chang, Xiaojun ;
Li, Zhihui ;
He, Zhenyu .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
[68]   Self-Supervised Deep Correlation Tracking [J].
Yuan, Di ;
Chang, Xiaojun ;
Huang, Po-Yao ;
Liu, Qiao ;
He, Zhenyu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :976-985
[69]   Robust visual tracking via co-trained Kernelized correlation filters [J].
Zhang, Le ;
Suganthan, Ponnuthurai Nagaratnam .
PATTERN RECOGNITION, 2017, 69 :82-93
[70]   Learning the Model Update for Siamese Trackers [J].
Zhang, Lichao ;
Gonzalez-Garcia, Abel ;
van de Weijer, Joost ;
Danelljan, Martin ;
Khan, Fahad Shahbaz .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4009-4018