Multi-source Transfer Learning Method by Balancing both the Domains and Instances

被引:0
作者
Ji D.-C. [1 ]
Jiang Y.-Z. [1 ]
Wang S.-T. [1 ]
机构
[1] School of Digital Media, Jiangnan University, Wuxi, 214122, Jiangsu
来源
Tien Tzu Hsueh Pao/Acta Electronica Sinica | 2019年 / 47卷 / 03期
关键词
Alternative optimization; Fuzzy C-means clustering; Instance weighting; Multi-source domain adaptation; Support vector regression; Transfer learning; Universum learning;
D O I
10.3969/j.issn.0372-2112.2019.03.025
中图分类号
学科分类号
摘要
When transfer learning attempts to leverage the decision knowledge effectively from multiple source domains to predict the labels of instances accurately in target domain, it should consider how to well balance source and target domains, and their instances in both domains.In this paper, a novel multi-source transfer learning method called mlti-source transfer learning by balancing both domains and instances (MTL-BDI) is proposed to achieve the above goal.The basic idea of the proposed method is to embed the doubly weighted domain-level and instance-level balance term into the original objective function of transfer learning and then solve the proposed objective function effectively by using the alternating optimization technique.Extensive experiments on text and image datasets indicate that the proposed method indeed outperforms several existing multi-source transfer learning methods MCC-SVM (Multiple Convex Combination of SVM), A-SVM (Adaptive SVM), Multi-KMM (Multiple Kernel Mean Matching) and DAM (Domain Adaptation Machine) in the sense of classification accuracy on target domain. © 2019, Chinese Institute of Electronics. All right reserved.
引用
收藏
页码:692 / 699
页数:7
相关论文
共 20 条
[1]  
Luo P., Zhuang F.Z., Xiong H., Et al., Transfer learning from multiple source domains via consensus regularization, Proceedings of the ACM International Conference on Information and Knowledge Management, pp. 103-112, (2008)
[2]  
Duan L., Xu D., Chang S.F., Exploiting web images for event recognition in consumer videos: A multiple source domain adaptation approach, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1338-1345, (2012)
[3]  
Yao Y., Doretto G., Boosting for transfer learning with multiple sources, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1855-1862, (2010)
[4]  
Sun S.L., Shi H.L., Wu Y.B., A survey of multi-source domain adaptation, Information Fusion, 24, C, pp. 84-92, (2015)
[5]  
Schweikert G., Widmer C., Scholkopf B., Et al., An empirical analysis of domain adaptation algorithms for genomic sequence analysis, Proceedings of the Neural Information Processing Systems Conference, pp. 1433-1440, (2009)
[6]  
Yang J., Yan R., Hauptmann A.G., Cross-domain video concept detection using adaptive SVMs, Proceedings of the ACM International Conference on Multimedia, pp. 188-197, (2007)
[7]  
Chattopadhyay R., Sun Q., Fan W., Et al., Multi-source domain adaptation and its application to early detection of fatigue, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 717-725, (2011)
[8]  
Duan L., Xu D., Tsang I.W., Domain adaptation from multiple sources: A domain-dependent regularization approach, IEEE Transaction on Neural Networks and Learning System, 23, 3, pp. 504-518, (2012)
[9]  
Weston J., Collobert R., Sinz F., Et al., Inference with the universum, Proceedings of the International Conference on Machine Learning, pp. 1009-1016, (2006)
[10]  
Bezdek J.C., Pattern Recognition with Fuzzy Objective Function Algorithms, pp. 43-93, (1981)