Online deep transferable dictionary learning

被引:8
作者
Wu, Sheng [1 ]
Wu, Ancong [1 ]
Zheng, Wei-Shi [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
关键词
Online transferable dictionary learning; Semi-supervised learning; Domain adaptation; K-SVD; IMAGE; ALGORITHM;
D O I
10.1016/j.patcog.2021.108007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world applications, large-scale unlabeled data usually becomes available gradually over time. Online learning is important to update models while preserving their historical knowledge. However, a time varying distribution shift exists in incoming sequential data in online learning, resulting in a data cluster discrepancy between the incoming unlabeled data and older labeled data, which is a challenging situation for online learning. To address this issue, we propose an online deep transferable dictionary learning (ODTDL) method that simultaneously mitigates the data cluster discrepancy for incoming unlabeled data while preserving historical knowledge of older data in the dictionary. By forming a locally linear representation and association of incoming unlabeled data over a small amount of labeled data in a deep feature space, the proposed ODTDL method can reveal data cluster discrepancies. To implement this approach, we propose a two-level affiliation regularizer that both comprehensively reveals the local instance-level and global cluster-level affiliations and enables an off-the-shelf dictionary reconstruction error method to establish a knowledge transfer pipeline between the labeled and unlabeled data. For online learning, this approach further decomposes the knowledge transfer pipeline into batchwise transfer pipelines, thereby establishing batchwise transfer pipelines between labeled and unlabeled data. Finally, the proposed method is confirmed to be feasible in online semi-supervised learning (SSL) and online unsupervised domain adaptation (UDA) scenarios and demonstrates its superiority in the online setting. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 57 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]  
Aljundi R, 2019, ADV NEUR IN, V32
[3]  
[Anonymous], 2007, CALTECH 256 OBJECT C
[4]   Incremental Evolving Domain Adaptation [J].
Bitarafan, Adeleh ;
Baghshah, Mahdieh Soleymani ;
Gheisari, Marzieh .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (08) :2128-2141
[5]   A Review of Computer Vision Techniques for the Analysis of Urban Traffic [J].
Buch, Norbert ;
Velastin, Sergio A. ;
Orwell, James .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2011, 12 (03) :920-939
[6]  
Conte S. D., 2017, ELEMENTARY NUMERICAL
[7]   Domain Transfer Multiple Kernel Learning [J].
Duan, Lixin ;
Tsang, Ivor W. ;
Xu, Dong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (03) :465-479
[8]   Unsupervised Visual Domain Adaptation Using Subspace Alignment [J].
Fernando, Basura ;
Habrard, Amaury ;
Sebban, Marc ;
Tuytelaars, Tinne .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2960-2967
[9]  
Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
[10]   Sparse Representation With Kernels [J].
Gao, Shenghua ;
Tsang, Ivor Wai-Hung ;
Chia, Liang-Tien .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (02) :423-434