Robust visual object tracking using context-based spatial variation via multi-feature fusion

被引:34
作者
Elayaperumal, Dinesh [1 ]
Joo, Young Hoon [1 ]
机构
[1] Kunsan Natl Univ, Sch IT Informat & Control Engn, 588 Daehak Ro, Gunsan Si 54150, Jeonbuk, South Korea
基金
新加坡国家研究基金会;
关键词
Correlation filter; Context; Spatial variation; Feature fusion; ADMM; Object tracking; CORRELATION FILTERS;
D O I
10.1016/j.ins.2021.06.084
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the emergence of camera technology, visual tracking has witnessed great attention in the field of computer vision. For instance, numerous discriminative correlation filter (DCF) methods are broadly used in tracking, nevertheless, most of them fail to efficiently find the target in challenging situations which leads to tracking failure throughout the sequences. In order to handle these issues, we propose contextual information based spatial variation with a multi-feature fusion method (CSVMF) for robust object tracking. This work incorporates the contextual information of the target to determine the location of the target accurately, which utilizes the relationship between the target and its surroundings to increase the efficiency of the tracker. In addition, we integrate the spatial variation information which measures the second-order difference of the filter to avoid the over-fitting problem caused by the changes in filter coefficient. Furthermore, we adopt multi-feature fusion strategy to enhance the target appearance by using different metrics. The tracking results from different features are fused by employing peak-to-sidelobe ratio (PSR) which measures the peak strength of the response. Finally, we conduct extensive experiments on TC128, DTB70, UAV123@10fps, and UAV123 datasets to demonstrate that the proposed method achieves a favorable performance over the existing ones. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:467 / 482
页数:16
相关论文
共 50 条
[41]  
Tian S., 2020, IEEE T MULTIMEDIA
[42]   Multi-Cue Correlation Filters for Robust Visual Tracking [J].
Wang, Ning ;
Zhou, Wengang ;
Tian, Qi ;
Hong, Richang ;
Wang, Meng ;
Li, Houqiang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4844-4853
[43]   Hierarchical Spatiotemporal Context-Aware Correlation Filters for Visual Tracking [J].
Wang, Wuwei ;
Zhang, Ke ;
Lv, Meibo ;
Wang, Jingyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (12) :6066-6079
[44]   Object Tracking Benchmark [J].
Wu, Yi ;
Lim, Jongwoo ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) :1834-1848
[45]   Adaptive Channel Selection for Robust Visual Object Tracking with Discriminative Correlation Filters [J].
Xu, Tianyang ;
Feng, Zhenhua ;
Wu, Xiao-Jun ;
Kittler, Josef .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (05) :1359-1375
[46]   Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking [J].
Xu, Tianyang ;
Feng, Zhen-Hua ;
Wu, Xiao-Jun ;
Kittler, Josef .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) :5596-5609
[47]   Context-Aware Visual Tracking [J].
Yang, Ming ;
Wu, Ying ;
Hua, Gang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (07) :1195-1209
[48]   Action-Decision Networks for Visual Tracking with Deep Reinforcement Learning [J].
Yun, Sangdoo ;
Choi, Jongwon ;
Yoo, Youngjoon ;
Yun, Kimin ;
Choi, Jin Young .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1349-1358
[49]  
Zhang JM, 2014, LECT NOTES COMPUT SC, V8694, P188, DOI 10.1007/978-3-319-10599-4_13
[50]   Advances in Deep Learning Methods for Visual Tracking: Literature Review and Fundamentals [J].
Zhang, Xiao-Qin ;
Jiang, Run-Hua ;
Fan, Chen-Xiang ;
Tong, Tian-Yu ;
Wang, Tao ;
Huang, Peng-Cheng .
INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2021, 18 (03) :311-333