Learning to Discover Knowledge: A Weakly-Supervised Partial Domain Adaptation Approach

被引:3
作者
Lan, Mengcheng [1 ]
Meng, Min [1 ]
Yu, Jun [2 ,3 ]
Wu, Jigang [1 ]
机构
[1] Guangdong Univ Technol, Dept Comp Sci, Guangzhou 510006, Peoples R China
[2] Harbin Inst Technol, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Noise measurement; Task analysis; Training; Adaptation models; Noise; Annotations; Standards; Domain adaptation; weakly-supervised learning; structural risk minimization; distribution adaptation; REGULARIZATION; FRAMEWORK;
D O I
10.1109/TIP.2024.3418581
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain adaptation has shown appealing performance by leveraging knowledge from a source domain with rich annotations. However, for a specific target task, it is cumbersome to collect related and high-quality source domains. In real-world scenarios, large-scale datasets corrupted with noisy labels are easy to collect, stimulating a great demand for automatic recognition in a generalized setting, i.e., weakly-supervised partial domain adaptation (WS-PDA), which transfers a classifier from a large source domain with noises in labels to a small unlabeled target domain. As such, the key issues of WS-PDA are: 1) how to sufficiently discover the knowledge from the noisy labeled source domain and the unlabeled target domain, and 2) how to successfully adapt the knowledge across domains. In this paper, we propose a simple yet effective domain adaptation approach, termed as self-paced transfer classifier learning (SP-TCL), to address the above issues, which could be regarded as a well-performing baseline for several generalized domain adaptation tasks. The proposed model is established upon the self-paced learning scheme, seeking a preferable classifier for the target domain. Specifically, SP-TCL learns to discover faithful knowledge via a carefully designed prudent loss function and simultaneously adapts the learned knowledge to the target domain by iteratively excluding source examples from training under the self-paced fashion. Extensive evaluations on several benchmark datasets demonstrate that SP-TCL significantly outperforms state-of-the-art approaches on several generalized domain adaptation tasks. Code is available at https://github.com/mc-lan/SP-TCL.
引用
收藏
页码:4090 / 4103
页数:14
相关论文
共 61 条
[1]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[2]   Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy [J].
Bruzzone, Lorenzo ;
Marconcini, Mattia .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (05) :770-787
[3]   Partial Adversarial Domain Adaptation [J].
Cao, Zhangjie ;
Ma, Lijia ;
Long, Mingsheng ;
Wang, Jianmin .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :139-155
[4]   Learning to Transfer Examples for Partial Domain Adaptation [J].
Cao, Zhangjie ;
You, Kaichao ;
Long, Mingsheng ;
Wang, Jianmin ;
Yang, Qiang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2980-2989
[5]   Partial Transfer Learning with Selective Adversarial Networks [J].
Cao, Zhangjie ;
Long, Mingsheng ;
Wang, Jianmin ;
Jordan, Michael I. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2724-2732
[6]   Domain Adversarial Reinforcement Learning for Partial Domain Adaptation [J].
Chen, Jin ;
Wu, Xinxiao ;
Duan, Lixin ;
Gao, Shenghua .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) :539-553
[7]   Domain Adaptation by Joint Distribution Invariant Projections [J].
Chen, Sentao ;
Harandi, Mehrtash ;
Jin, Xiaona ;
Yang, Xiaowei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :8264-8277
[8]   A Graph Embedding Framework for Maximum Mean Discrepancy-Based Domain Adaptation Algorithms [J].
Chen, Yiming ;
Song, Shiji ;
Li, Shuang ;
Wu, Cheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :199-213
[9]  
Chen Z., 2020, IEEE C COMP VIS PATT, P12706
[10]   Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification [J].
Deng, Weijian ;
Zheng, Liang ;
Ye, Qixiang ;
Kang, Guoliang ;
Yang, Yi ;
Jiao, Jianbin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :994-1003