Class-aware sample reweighting optimal transport for multi-source domain adaptation

被引:58
作者
Wang, Shengsheng [1 ,2 ]
Wang, Bilin [1 ,2 ]
Zhang, Zhe [3 ]
Heidari, Ali Asghar [4 ]
Chen, Huiling [5 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, 2699 Qianjin St, Changchun 130012, Jilin, Peoples R China
[2] Jilin Univ, Key Lab Symbol Computat, Knowledge Engn Minist Educ, 2699 Qianjin St, Changchun 130012, Jilin, Peoples R China
[3] Chinese Acad Sci, Suzhou Inst Biomed Engn & Technol, Key Lab Med Lab Technol, 88 Keling St, Suzhou 215163, Jiangsu, Peoples R China
[4] Univ Tehran, Coll Engn, Sch Surveying & Geospatial Engn, Tehran, Iran
[5] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Zh, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Optimal transport; Unsupervised domain adaptation; Multi-source; Class-aware sampling;
D O I
10.1016/j.neucom.2022.12.048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-Source Domain Adaptation (MSDA) techniques have attracted widespread attention due to their availability to transfer knowledge from multiple source domains to the unlabeled target domain. Optimal transport (OT) has recently been utilized to measure the distance between distributions in virtue of its robustness. This paper proposes a novel OT-based Class-Aware Sample Reweighting (CASR) method to achieve sample-level fine-grained alignment between multi-source and target. Technically, the class-aware sampling strategy ensures class-level conditional alignment during transport by explicitly select-ing samples from each domain. Besides, the sample-reweighting module is designed to allocate specific mass to each transmitted sample, which considers the classification reliability and the spatial informa-tion correlation to obtain the alignment priority between target and multi-source and further optimize the transport plan. Extensive experiments conducted on several benchmarks show that CASR presents significant advantages compared with other MSDA methods, and the visualization analysis further demonstrates the effectiveness of each proposed module.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:213 / 223
页数:11
相关论文
共 63 条
[1]   Heterogeneous domain adaptation with statistical distribution alignment and progressive pseudo label selection [J].
Alipour, Naimeh ;
Tahmoresnezhad, Jafar .
APPLIED INTELLIGENCE, 2022, 52 (07) :8038-8055
[2]  
Blitzer J., 2007, ADV NEURAL INFORM PR, V20
[3]  
Chen Y, 2022, Neurocomputing
[4]   Generative Adversarial Networks in Medical Image augmentation: A review [J].
Chen, Yizhou ;
Yang, Xu-Hua ;
Wei, Zihan ;
Heidari, Ali Asghar ;
Zheng, Nenggan ;
Li, Zhicheng ;
Chen, Huiling ;
Hu, Haigen ;
Zhou, Qianwei ;
Guan, Qiu .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 144
[5]   Unbalanced optimal transport: Dynamic and Kantorovich formulations [J].
Chizat, Lenaic ;
Peyre, Gabriel ;
Schmitzer, Bernhard ;
Vialard, Francois-Xavier .
JOURNAL OF FUNCTIONAL ANALYSIS, 2018, 274 (11) :3090-3123
[6]  
Courty Nicolas, 2014, Machine Learning and Knowledge Discovery in Databases. European Conference, ECML PKDD 2014. Proceedings: LNCS 8724, P274, DOI 10.1007/978-3-662-44848-9_18
[7]   Optimal Transport for Domain Adaptation [J].
Courty, Nicolas ;
Flamary, Remi ;
Tuia, Devis ;
Rakotomamonjy, Alain .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (09) :1853-1865
[8]   A Semi-Supervised Extreme Learning Machine Algorithm Based on the New Weighted Kernel for Machine Smell [J].
Dang, Wei ;
Guo, Jialiang ;
Liu, Mingzhe ;
Liu, Shan ;
Yang, Bo ;
Yin, Lirong ;
Zheng, Wenfeng .
APPLIED SCIENCES-BASEL, 2022, 12 (18)
[9]  
Fatras K, 2021, PR MACH LEARN RES, V139
[10]  
Fatras K, 2021, Arxiv, DOI arXiv:2101.01792