The online scene-adaptive tracker based on self-supervised learning

被引:0
|
作者
Xiaoyu Chen
Mingyang Chen
Jinru Hang
Fengchen He
Wei Qi
Jing Han
机构
[1] Nanjing University of Science and Technology,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
[2] AVIC Suzhou Changfeng Avionics,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
来源
关键词
Object tracking; Siamese network; Online scene-adaptive; Self-supervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, with the advancement of deep learning technology, visual object tracking has developed rapidly. However, the real world is complex and changeable, and the CNN-based trackers lack an effective updating mechanism for unseen targets and scene adaptation. Aiming at the two key issues that existed in current trackers algorithms: (1) the poor generalization with the limited offline training data; (2) lacking an online model updating mechanism for scene adaptation, this paper designs a simple and effective self-supervised framework for online model adaptation and propose OSATracker, which construct a cycle self-supervision based on unlabeled online data. OSATracker utilizes decision-level information to update the model rather than template by self-supervised optimization in the online tracking process, which effectively improves the generalization ability of the model in the tracking process. Extensive experiments on visual tracking benchmarks including VOT2018, VOT2016, OTB2015, and OTB2013 demonstrate the effectiveness of OSATracker with outstanding performance.
引用
收藏
页码:15695 / 15713
页数:18
相关论文
共 50 条
  • [21] When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework
    Zhao, Zhicheng
    Luo, Ze
    Li, Jian
    Chen, Can
    Piao, Yingchao
    REMOTE SENSING, 2020, 12 (20) : 1 - 22
  • [22] Wavelet-based self-supervised learning for multi-scene image fusion
    Liu, Shaolei
    Qu, Linhao
    Qiao, Qin
    Wang, Manning
    Song, Zhijian
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (18): : 15689 - 15704
  • [23] Wavelet-based self-supervised learning for multi-scene image fusion
    Shaolei Liu
    Linhao Qu
    Qin Qiao
    Manning Wang
    Zhijian Song
    Neural Computing and Applications, 2022, 34 : 15689 - 15704
  • [24] Improving Predicate Representation in Scene Graph Generation by Self-Supervised Learning
    Hasegawa, So
    Hiromoto, Masayuki
    Nakagawa, Akira
    Umeda, Yuhei
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2739 - 2748
  • [25] Repeat and learn: Self-supervised visual representations learning by Scene Localization
    Altabrawee, Hussein
    Noor, Mohd Halim Mohd
    PATTERN RECOGNITION, 2024, 156
  • [26] DIFFERENCING BASED SELF-SUPERVISED PRETRAINING FOR SCENE CHANGE DETECTION
    Ramkumar, Vijaya Raghavan T.
    Arani, Elahe
    Zonooz, Bahram
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 199, 2022, 199
  • [27] Unsupervised object detection with scene-adaptive concept learning
    Pu, Shiliang
    Zhao, Wei
    Chen, Weijie
    Yang, Shicai
    Xie, Di
    Pan, Yunhe
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (05) : 638 - 651
  • [28] SELF-SUPERVISED ADAPTIVE NETWORKS
    LUTTRELL, SP
    IEE PROCEEDINGS-F RADAR AND SIGNAL PROCESSING, 1992, 139 (06) : 371 - 377
  • [29] Scene-adaptive radar tracking with deep reinforcement learning
    Stephan, Michael
    Servadei, Lorenzo
    Arjona-Medina, Jose
    Santra, Avik
    Wille, Robert
    Fischer, Georg
    MACHINE LEARNING WITH APPLICATIONS, 2022, 8
  • [30] Improving robot navigation through self-supervised Online learning
    Sofman, Boris
    Lin, Ellie
    Bagnell, J. Andrew
    Cole, John
    Vandapel, Nicolas
    Stentz, Anthony
    JOURNAL OF FIELD ROBOTICS, 2006, 23 (11-12) : 1059 - 1075