Learning discriminative update adaptive spatial-temporal regularized correlation filter for RGB-T tracking

被引:23
|
作者
Feng, Mingzheng [1 ,2 ]
Song, Kechen [1 ,2 ]
Wang, Yanyan [1 ,2 ]
Liu, Jie [1 ,2 ]
Yan, Yunhui [1 ,2 ]
机构
[1] Northeastern Univ, Sch Mech Engn & Automat, Shenyang, Liaoning, Peoples R China
[2] Energy Saving Met Equipment & Intelligent Detect, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; Correlation filters; Adaptive spatial-temporal regularization; ADMM; Model updating; VISUAL TRACKING; FUSION TRACKING; ROBUST; SIAMESE;
D O I
10.1016/j.jvcir.2020.102881
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The RGB-T trackers based on correlation filter framework have been extensively investigated for that they can track targets more accurately in most complex scenes. However, the performance of these trackers is limited when facing some specific challenging scenarios, such as occlusion and background clutter. For different tracking targets, most of these trackers utilize fixed regularization constraint to build the filter model, which is obviously unreasonable to effectively present the appearance changes and characteristics of a specific target. In addition, they adopt a simple model update mechanism based on linear interpolation, which can easily lead to model degradation in challenging scenarios, resulting in tracker drift. To solve the above problems, we propose a novel adaptive spatial-temporal regularized correlation filter model to learn an appropriate regularization for achieving robust tracking and a relative peak discriminative method for model updating to avoid the model degradation. Besides, to make better integrate the unique advantages of the two modes and adapt the changing appearance of the target, an adaptive weighting ensemble scheme and a multi-scale search mechanism are adopted, respectively. To optimize the proposed model, we designed an efficient ADMM algorithm, which greatly improved the efficiency. Extensive experiments have been carried out on two available datasets, RGBT234 and RGBT210, and the experimental results indicate that the tracker proposed by us performs favorably in both accuracy and robustness against the state-of-the-art RGB-T trackers.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Learning adaptive spatial-temporal regularized correlation filters for visual tracking
    Zhao, Jianwei
    Li, Yangxiao
    Zhou, Zhenghua
    IET IMAGE PROCESSING, 2021, 15 (08) : 1773 - 1785
  • [2] RGB-T Tracking via Multi-expert Correlation Filters using Spatial-temporal Robustness
    Zhang, Fei
    Ma, Shiping
    Li, Zhijun
    Zhang, Yule
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 356 - 360
  • [3] Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking
    Li, Feng
    Tian, Cheng
    Zuo, Wangmeng
    Zhang, Lei
    Yang, Ming-Hsuan
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4904 - 4913
  • [4] Spatial-Temporal Regularized Correlation Filter with Precise State Estimation for Visual Tracking
    Tang, Zhaoqian
    Arakawa, Kaoru
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2022, E105A (06) : 914 - 922
  • [5] LEARNING SPATIAL-TEMPORAL CONSISTENT CORRELATION FILTER FOR VISUAL TRACKING
    Lou, Han
    Wang, Dongfei
    Jiang, Zhuqing
    Men, Aidong
    Zhou, Yun
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2017,
  • [6] Kalman Filter for Spatial-Temporal Regularized Correlation Filters
    Feng, Sheng
    Hu, Keli
    Fan, En
    Zhao, Liping
    Wu, Chengdong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3263 - 3278
  • [7] Spatial-temporal adaptive feature weighted correlation filter for visual tracking
    Du, Fei
    Liu, Peng
    Zhao, Wei
    Tang, Xianglong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 58 - 70
  • [8] Adaptive spatial-temporal surrounding-aware correlation filter tracking via ensemble learning
    Moorthy, Sathishkumar
    Joo, Young Hoon
    PATTERN RECOGNITION, 2023, 139
  • [9] Exploring Multi-Modal Spatial-Temporal Contexts for High-Performance RGB-T Tracking
    Zhang, Tianlu
    Jiao, Qiang
    Zhang, Qiang
    Han, Jungong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4303 - 4318
  • [10] Weighted Sparse Representation Regularized Graph Learning for RGB-T Object Tracking
    Li, Chenglong
    Zhao, Nan
    Lu, Yijuan
    Zhu, Chengli
    Tang, Jin
    PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1856 - 1864