Learning discriminative update adaptive spatial-temporal regularized correlation filter for RGB-T tracking

被引:23
|
作者
Feng, Mingzheng [1 ,2 ]
Song, Kechen [1 ,2 ]
Wang, Yanyan [1 ,2 ]
Liu, Jie [1 ,2 ]
Yan, Yunhui [1 ,2 ]
机构
[1] Northeastern Univ, Sch Mech Engn & Automat, Shenyang, Liaoning, Peoples R China
[2] Energy Saving Met Equipment & Intelligent Detect, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; Correlation filters; Adaptive spatial-temporal regularization; ADMM; Model updating; VISUAL TRACKING; FUSION TRACKING; ROBUST; SIAMESE;
D O I
10.1016/j.jvcir.2020.102881
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The RGB-T trackers based on correlation filter framework have been extensively investigated for that they can track targets more accurately in most complex scenes. However, the performance of these trackers is limited when facing some specific challenging scenarios, such as occlusion and background clutter. For different tracking targets, most of these trackers utilize fixed regularization constraint to build the filter model, which is obviously unreasonable to effectively present the appearance changes and characteristics of a specific target. In addition, they adopt a simple model update mechanism based on linear interpolation, which can easily lead to model degradation in challenging scenarios, resulting in tracker drift. To solve the above problems, we propose a novel adaptive spatial-temporal regularized correlation filter model to learn an appropriate regularization for achieving robust tracking and a relative peak discriminative method for model updating to avoid the model degradation. Besides, to make better integrate the unique advantages of the two modes and adapt the changing appearance of the target, an adaptive weighting ensemble scheme and a multi-scale search mechanism are adopted, respectively. To optimize the proposed model, we designed an efficient ADMM algorithm, which greatly improved the efficiency. Extensive experiments have been carried out on two available datasets, RGBT234 and RGBT210, and the experimental results indicate that the tracker proposed by us performs favorably in both accuracy and robustness against the state-of-the-art RGB-T trackers.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Action recognition with spatial-temporal discriminative filter banks
    Martinez, Brais
    Modolo, Davide
    Xiong, Yuanjun
    Tighe, Joseph
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5481 - 5490
  • [32] Learning a Twofold Siamese Network for RGB-T Object Tracking
    Kuai, Yangliu
    Li, Dongdong
    Qian, Que
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (05)
  • [33] Visual Tracking via Spatial-Temporal Regularized Correlation Filters with Advanced State Estimation
    Tang, Zhao-Qian
    Arakawa, Kaoru
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1145 - 1149
  • [34] Visual tracking via confidence template updating spatial-temporal regularized correlation filters
    Liang, Mengquan
    Wu, Xuedong
    Tang, Siming
    Zhu, Zhiyu
    Wang, Yaonan
    Zhang, Qiang
    Cao, Baiheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (12) : 37053 - 37072
  • [35] Visual tracking via confidence template updating spatial-temporal regularized correlation filters
    Mengquan Liang
    Xuedong Wu
    Siming Tang
    Zhiyu Zhu
    Yaonan Wang
    Qiang Zhang
    Baiheng Cao
    Multimedia Tools and Applications, 2024, 83 : 37053 - 37072
  • [36] Learning Adaptive Attribute-Driven Representation for Real-Time RGB-T Tracking
    Pengyu Zhang
    Dong Wang
    Huchuan Lu
    Xiaoyun Yang
    International Journal of Computer Vision, 2021, 129 : 2714 - 2729
  • [37] Learning cross-modal interaction for RGB-T tracking
    Xu, Chunyan
    Cui, Zhen
    Wang, Chaoqun
    Zhou, Chuanwei
    Yang, Jian
    SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (01)
  • [38] Learning cross-modal interaction for RGB-T tracking
    Chunyan XU
    Zhen CUI
    Chaoqun WANG
    Chuanwei ZHOU
    Jian YANG
    Science China(Information Sciences), 2023, 66 (01) : 320 - 321
  • [39] Learning cross-modal interaction for RGB-T tracking
    Chunyan Xu
    Zhen Cui
    Chaoqun Wang
    Chuanwei Zhou
    Jian Yang
    Science China Information Sciences, 2023, 66
  • [40] Learning Adaptive Attribute-Driven Representation for Real-Time RGB-T Tracking
    Zhang, Pengyu
    Wang, Dong
    Lu, Huchuan
    Yang, Xiaoyun
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (09) : 2714 - 2729