Heterogeneous transfer learning: recent developments, applications, and challenges

被引:3
作者
Khan, Siraj [1 ]
Yin, Pengshuai [2 ]
Guo, Yuxin [3 ]
Asim, Muhammad [4 ,5 ]
Abd El-Latif, Ahmed A. [4 ,6 ]
机构
[1] South China Univ Technol, Sch Software Engn, Guangzhou, Peoples R China
[2] Guangdong Lab Artificial Intelligence & Digital Ec, Shenzhen, Peoples R China
[3] Guangzhou Inst Sci & Technol, Guangzhou, Peoples R China
[4] Prince Sultan Univ, Coll Comp & Informat Sci, EIAS Data Sci Lab, Riyadh 11586, Saudi Arabia
[5] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R China
[6] Menoufia Univ, Fac Sci, Dept Math & Comp Sci, Shibin Al Kawm 32511, Egypt
基金
中国国家自然科学基金;
关键词
Machine learning; Transfer learning; Heterogeneous transfer learning; Feature spaces; Knowledge transfer; DOMAIN ADAPTATION; RECOGNITION;
D O I
10.1007/s11042-024-18352-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transfer learning (TL) has emerged as a promising area of research in machine learning (ML) due to its ability to enhance learning efficiency and accuracy by leveraging knowledge from related domains. However, traditional TL is limited in its applicability to real-world scenarios where the assumption of identical feature spaces and distributions between source and target domains is untenable. To address this limitation, Heterogeneous Transfer Learning (HeTL) has emerged as an important research direction that enables knowledge transfer between domains with heterogeneous feature spaces and distributions. Motivated by the growing interest and significance of HeTL, this survey paper comprehensively reviews recent HeTL developments, beginning with mathematical TL definitions and a taxonomy of TL categories. It delves into HeTL, explaining its classification and research status, and highlights symmetric and asymmetric HeTL advancements. Next, we explored the applications of HeTL in various disciplines, such as image and text classification, activity recognition, and cross-project defect prediction, emphasizing HeTL's advantages over Traditional TL. Furthermore, we also discuss the challenges in HeTL, such as heterogeneity, transferability, negative learning, interpretability, and explainability. Finally, we conclude with a discussion on HeTL directions for future research.
引用
收藏
页码:69759 / 69795
页数:37
相关论文
共 118 条
[1]  
Ando RK, 2005, J MACH LEARN RES, V6, P1817
[2]  
[Anonymous], 2007, P 24 INT C MACHINE, DOI [DOI 10.1145/1273496.1273592, 10.1145/1273496.1273592]
[3]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
[4]  
Baik S, 2020, ADV NEUR IN, V33
[5]  
Bica I., 2022, Advances in Neural Information Processing Systems, V35, P37184
[6]  
Blanke U., 2010, Wearable Computers (ISWC), 2010 International Symposium on, P1
[7]  
Blitzer J., 2007, P ADV NEUR INF PROC, P1
[8]  
Blitzer JC, 2006, Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, P120, DOI DOI 10.3115/1610075.1610094
[9]   Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission [J].
Caruana, Rich ;
Lou, Yin ;
Gehrke, Johannes ;
Koch, Paul ;
Sturm, Marc ;
Elhadad, Noemie .
KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, :1721-1730
[10]   Facilitating innovation and knowledge transfer between homogeneous and heterogeneous datasets: Generic incremental transfer learning approach and multidisciplinary studies [J].
Chui, Kwok Tai ;
Arya, Varsha ;
Band, Shahab S. ;
Alhalabi, Mobeen ;
Liu, Ryan Wen ;
Chi, Hao Ran .
JOURNAL OF INNOVATION & KNOWLEDGE, 2023, 8 (02)