The online scene-adaptive tracker based on self-supervised learning

被引:0
|
作者
Xiaoyu Chen
Mingyang Chen
Jinru Hang
Fengchen He
Wei Qi
Jing Han
机构
[1] Nanjing University of Science and Technology,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
[2] AVIC Suzhou Changfeng Avionics,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
来源
关键词
Object tracking; Siamese network; Online scene-adaptive; Self-supervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, with the advancement of deep learning technology, visual object tracking has developed rapidly. However, the real world is complex and changeable, and the CNN-based trackers lack an effective updating mechanism for unseen targets and scene adaptation. Aiming at the two key issues that existed in current trackers algorithms: (1) the poor generalization with the limited offline training data; (2) lacking an online model updating mechanism for scene adaptation, this paper designs a simple and effective self-supervised framework for online model adaptation and propose OSATracker, which construct a cycle self-supervision based on unlabeled online data. OSATracker utilizes decision-level information to update the model rather than template by self-supervised optimization in the online tracking process, which effectively improves the generalization ability of the model in the tracking process. Extensive experiments on visual tracking benchmarks including VOT2018, VOT2016, OTB2015, and OTB2013 demonstrate the effectiveness of OSATracker with outstanding performance.
引用
收藏
页码:15695 / 15713
页数:18
相关论文
共 50 条
  • [41] Object Detection with Self-Supervised Scene Adaptation
    Zhang, Zekun
    Hoai, Minh
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21589 - 21599
  • [42] Repeatable adaptive keypoint detection via self-supervised learning
    Pei Yan
    Yihua Tan
    Yuan Tai
    Science China Information Sciences, 2022, 65
  • [43] MAST: A Memory-Augmented Self-Supervised Tracker
    Lai, Zihang
    Lu, Erika
    Xie, Weidi
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6478 - 6487
  • [44] Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces
    Sun, Li
    Ye, Junda
    Peng, Hao
    Wang, Feiyang
    Yu, Philip S.
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4633 - 4642
  • [45] Repeatable adaptive keypoint detection via self-supervised learning
    Pei YAN
    Yihua TAN
    Yuan TAI
    Science China(Information Sciences), 2022, 65 (11) : 123 - 147
  • [46] Self-Supervised Learning With Adaptive Distillation for Hyperspectral Image Classification
    Yue, Jun
    Fang, Leyuan
    Rahmani, Hossein
    Ghamisi, Pedram
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] Repeatable adaptive keypoint detection via self-supervised learning
    Yan, Pei
    Tan, Yihua
    Tai, Yuan
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (11)
  • [48] Self-Supervised Scene De-occlusion
    Zhan, Xiaohang
    Pan, Xingang
    Dai, Bo
    Liu, Ziwei
    Lin, Dahua
    Loy, Chen Change
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3783 - 3791
  • [49] Online Evaluation Method of CVT Internal Insulation Abnormality Based on Self-Supervised Learning
    He, Jun
    Zhou, Zhihao
    Tong, Chao
    Li, Fan
    Rao, Fangxi
    Xu, Qiu
    ENERGIES, 2023, 16 (12)
  • [50] A scene-adaptive motion detection model based on machine learning and data clustering
    Hu, Tao
    Zheng, Minghui
    Li, Jun
    Zhu, Li
    Hu, Jia
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (08) : 2821 - 2839