The online scene-adaptive tracker based on self-supervised learning

被引:0
|
作者
Xiaoyu Chen
Mingyang Chen
Jinru Hang
Fengchen He
Wei Qi
Jing Han
机构
[1] Nanjing University of Science and Technology,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
[2] AVIC Suzhou Changfeng Avionics,Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense
来源
关键词
Object tracking; Siamese network; Online scene-adaptive; Self-supervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, with the advancement of deep learning technology, visual object tracking has developed rapidly. However, the real world is complex and changeable, and the CNN-based trackers lack an effective updating mechanism for unseen targets and scene adaptation. Aiming at the two key issues that existed in current trackers algorithms: (1) the poor generalization with the limited offline training data; (2) lacking an online model updating mechanism for scene adaptation, this paper designs a simple and effective self-supervised framework for online model adaptation and propose OSATracker, which construct a cycle self-supervision based on unlabeled online data. OSATracker utilizes decision-level information to update the model rather than template by self-supervised optimization in the online tracking process, which effectively improves the generalization ability of the model in the tracking process. Extensive experiments on visual tracking benchmarks including VOT2018, VOT2016, OTB2015, and OTB2013 demonstrate the effectiveness of OSATracker with outstanding performance.
引用
收藏
页码:15695 / 15713
页数:18
相关论文
共 50 条
  • [31] Self-Supervised Chinese Ontology Learning from Online Encyclopedias
    Hu, Fanghuai
    Shao, Zhiqing
    Ruan, Tong
    SCIENTIFIC WORLD JOURNAL, 2014,
  • [32] Online Self-Supervised Deep Learning for Intrusion Detection Systems
    Nakip, Mert
    Gelenbe, Erol
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 5668 - 5683
  • [33] Self-Supervised Online Learning of Basic Object Push Affordances
    Ridge, Barry
    Leonardis, Ales
    Ude, Ales
    Denisa, Miha
    Skocaj, Danijel
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2015, 12
  • [34] Distill on the Go: Online knowledge distillation in self-supervised learning
    Bhat, Prashant
    Arani, Elahe
    Zonooz, Bahram
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2672 - 2681
  • [35] Remote Sensing Image Scene Classification with Self-Supervised Learning Based on Partially Unlabeled Datasets
    Chen, Xiliang
    Zhu, Guobin
    Liu, Mingqing
    REMOTE SENSING, 2022, 14 (22)
  • [36] Improvements to context based self-supervised learning
    Mundhenk, T. Nathan
    Ho, Daniel
    Chen, Barry Y.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 9339 - 9348
  • [37] TransWCD: Scene-Adaptive Joint Constrained Framework for Weakly Supervised Change Detection
    Zhao, Zhenghui
    Ru, Lixiang
    Wu, Chen
    Wang, Di
    IEEE Transactions on Geoscience and Remote Sensing, 2025, 63
  • [38] A scene-adaptive motion detection model based on machine learning and data clustering
    Tao Hu
    Minghui Zheng
    Jun Li
    Li Zhu
    Jia Hu
    Multimedia Tools and Applications, 2015, 74 : 2821 - 2839
  • [39] Adversarial Self-Supervised Scene Flow Estimation
    Zuanazzi, Victor
    van Vugt, Joris
    Booij, Olaf
    Mettes, Pascal
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 1049 - 1058
  • [40] SCENE REPRESENTATION LEARNING FROM VIDEOS USING SELF-SUPERVISED AND WEAKLY-SUPERVISED TECHNIQUES
    Peri, Raghuveer
    Parthasarathy, Srinivas
    Sundaram, Shiva
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1671 - 1675