A Reliable Sample Selection Strategy for Weakly Supervised Visual Tracking

被引:37
作者
Liu, Shuai [1 ]
Xu, Xiyu [1 ]
Zhang, Yang [1 ]
Muhammad, Khan [2 ]
Fu, Weina [1 ]
机构
[1] Hunan Normal Univ, Hunan Prov Key Lab Intelligent Comp & Language In, Changsha 410081, Peoples R China
[2] Sungkyunkwan Univ, Visual Analyt Knowledge Lab, Dept Appl Artificial Intelligence, Sch Convergence,Coll Comp & Informat, Seoul 03063, South Korea
关键词
Reliability; Feature extraction; Visualization; Target tracking; Task analysis; Training; Adaptation models; Label quality; sample selection; system reliability; visual tracking; weak supervision;
D O I
10.1109/TR.2022.3162346
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Reliability is an important property in the applied engineering systems, especially in visual tracking. The supervised visual tracking method uses reliable ground truth that is manually annotated, which is hard to get in many applications. However, weakly supervised visual trackings are limited by the low-quality labels. Therefore, a reliable sample selection strategy is the most important issue for the weakly supervised visual trackings. In this article, we propose an optimal sample selection strategy and apply it to the visual tracking system. The strategy first assesses the reliability of the samples according to the score map, where the score map is the pseudolabel generated by the upstream task to meet the needs of the downstream task. Then, the unreliable pseudolabels are replaced by reliable ground truth or discarded to overcome the degraded modeling problem by filtering low-quality samples. Finally, through comparison with multiple selection strategies, it is verified that the model trained using this strategy has the best performance. The proposed visual tracking model achieves the best performance among multiple assessment metrics in multiple datasets. Experiments verify that the scientific sample quality assessment method is very important. It can guide the improvement of model performance, which is of great help to the weakly supervised learning systems based on data.
引用
收藏
页码:15 / 26
页数:12
相关论文
共 40 条
  • [1] Alexe B, 2010, LECT NOTES COMPUT SC, V6315, P380, DOI 10.1007/978-3-642-15555-0_28
  • [2] Multiscale Combinatorial Grouping
    Arbelaez, Pablo
    Pont-Tuset, Jordi
    Barron, Jonathan T.
    Marques, Ferran
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 328 - 335
  • [3] MULTI-HIERARCHICAL INDEPENDENT CORRELATION FILTERS FOR VISUAL TRACKING
    Bai, Shuai
    He, Zhiqun
    Dong, Yuan
    Bai, Hongliang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [4] Learning Discriminative Model Prediction for Tracking
    Bhat, Goutam
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6181 - 6190
  • [5] CAI Z, IEEE T RELIAB
  • [6] Data Evaluation and Enhancement for Quality Improvement of Machine Learning
    Chen, Haihua
    Chen, Jiangping
    Ding, Junhua
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2021, 70 (02) : 831 - 847
  • [7] Siamese Box Adaptive Network for Visual Tracking
    Chen, Zedu
    Zhong, Bineng
    Li, Guorong
    Zhang, Shengping
    Ji, Rongrong
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6667 - 6676
  • [8] Learning to Filter: Siamese Relation Network for Robust Tracking
    Cheng, Siyuan
    Zhong, Bineng
    Li, Guorong
    Liu, Xin
    Tang, Zhenjun
    Li, Xianxian
    Wang, Jing
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4419 - 4429
  • [9] BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation
    Dai, Jifeng
    He, Kaiming
    Sun, Jian
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1635 - 1643
  • [10] Visual Tracking via Adaptive Spatially-Regularized Correlation Filters
    Dai, Kenan
    Wang, Dong
    Lu, Huchuan
    Sun, Chong
    Li, Jianhua
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4665 - 4674