The online scene-adaptive tracker based on self-supervised learning

被引:0
|
作者
Xiaoyu Chen
Mingyang Chen
Jinru Hang
Fengchen He
Wei Qi
Jing Han
机构
[1] Nanjing University of Science and Technology,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
[2] AVIC Suzhou Changfeng Avionics,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
来源
关键词
Object tracking; Siamese network; Online scene-adaptive; Self-supervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, with the advancement of deep learning technology, visual object tracking has developed rapidly. However, the real world is complex and changeable, and the CNN-based trackers lack an effective updating mechanism for unseen targets and scene adaptation. Aiming at the two key issues that existed in current trackers algorithms: (1) the poor generalization with the limited offline training data; (2) lacking an online model updating mechanism for scene adaptation, this paper designs a simple and effective self-supervised framework for online model adaptation and propose OSATracker, which construct a cycle self-supervision based on unlabeled online data. OSATracker utilizes decision-level information to update the model rather than template by self-supervised optimization in the online tracking process, which effectively improves the generalization ability of the model in the tracking process. Extensive experiments on visual tracking benchmarks including VOT2018, VOT2016, OTB2015, and OTB2013 demonstrate the effectiveness of OSATracker with outstanding performance.
引用
收藏
页码:15695 / 15713
页数:18
相关论文
共 50 条
  • [1] The online scene-adaptive tracker based on self-supervised learning
    Chen, Xiaoyu
    Chen, Mingyang
    Hang, Jinru
    He, Fengchen
    Qi, Wei
    Han, Jing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (10) : 15695 - 15713
  • [2] Self-Supervised Online Metric Learning With Low Rank Constraint for Scene Categorization
    Cong, Yang
    Liu, Ji
    Yuan, Junsong
    Luo, Jiebo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (08) : 3179 - 3191
  • [3] Adaptive Robot Traversability Estimation Based on Self-Supervised Online Continual Learning in Unstructured Environments
    Yoon, Hyung-Suk
    Hwang, Ji-Hoon
    Kim, Chan
    Son, E. In
    Yoo, Se-Wook
    Seo, Seung-Woo
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06): : 4902 - 4909
  • [4] Self-Supervised Learning for Heterogeneous Audiovisual Scene Analysis
    Hu, Di
    Wang, Zheng
    Nie, Feiping
    Wang, Rong
    Li, Xuelong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3534 - 3545
  • [5] Self-Supervised Learning for Online Speaker Diarization
    Chien, Jen-Tzung
    Luo, Sixun
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 2036 - 2042
  • [6] Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning
    Huang, Lang
    Zhang, Chao
    Zhang, Hongyang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1362 - 1377
  • [7] Learning scene-adaptive pseudo annotations for pedestrian detection in semi-supervised scenarios
    Wu, Wenhao
    Jiao, Qianfen
    Wong, Hau-San
    Li, Gaozhe
    Wu, Si
    KNOWLEDGE-BASED SYSTEMS, 2022, 243
  • [8] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [9] Scene-adaptive Moving Detection with Machine Learning based on Clustering
    Hu, Tao
    Zheng, Minghui
    Li, Jun
    Zhu, Li
    2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 1782 - 1787
  • [10] Self-supervised Adaptive Aggregator Learning on Graph
    Lin, Bei
    Luo, Binli
    He, Jiaojiao
    Gui, Ning
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 29 - 41