Facilitating innovation and knowledge transfer between homogeneous and heterogeneous datasets: Generic incremental transfer learning approach and multidisciplinary studies

被引:11
作者
Chui, Kwok Tai [1 ]
Arya, Varsha [2 ,3 ,4 ]
Band, Shahab S. [5 ]
Alhalabi, Mobeen [6 ]
Liu, Ryan Wen [7 ]
Chi, Hao Ran [8 ]
机构
[1] Hong Kong Metropolitan Univ, Sch Sci & Technol, Dept Elect Engn & Comp Sci, Ho Man Tin,Kowloon, Hong Kong, Peoples R China
[2] Insights2Techinfo, Delhi, India
[3] Asia Univ, Taichung, Taiwan
[4] Lebanese Amer Univ, Beirut 1102, Lebanon
[5] Natl Yunlin Univ Sci & Technol, Dept Comp Sci, Touliu, Taiwan
[6] King Abdulaziz Univ, Dept Comp Sci, Jeddah, Saudi Arabia
[7] Wuhan Univ Technol, Sch Nav, Hubei Key Lab Inland Shipping Technol, Wuhan 430063, Peoples R China
[8] Inst Telecomunicacoes, P-3810193 Aveiro, Portugal
来源
JOURNAL OF INNOVATION & KNOWLEDGE | 2023年 / 8卷 / 02期
关键词
Deep learning; Domain knowledge; Incremental learning; Innovation transfer; Knowledge transfer; Transfer learning; CLASSIFICATION; ALGORITHMS;
D O I
10.1016/j.jik.2023.100313
中图分类号
F [经济];
学科分类号
02 ;
摘要
Open datasets serve as facilitators for researchers to conduct research with ground truth data. Generally, datasets contain innovation and knowledge in the domains that could be transferred between homogeneous datasets and have become feasible using machine learning models with the advent of transfer learning algorithms. Research initiatives are drawn to the heterogeneous datasets if these could extract useful innovation and knowledge across datasets of different domains. A breakthrough can be achieved without the restriction requiring the similarities between datasets. A multiple incremental transfer learning is proposed to yield optimal results in the target model. A multiple rounds multiple incremental transfer learning with a negative transfer avoidance algorithm are proposed as a generic approach to transfer innovation and knowledge from the source domain to the target domain. Incremental learning has played an important role in lowering the risk of transferring unrelated information which reduces the performance of machine learning models. To evaluate the effectiveness of the proposed algorithm, multidisciplinary studies are carried out in 5 disciplines with 15 benchmark datasets. Each discipline comprises 3 datasets as studies with homogeneous datasets whereas heterogeneous datasets are formed between disciplines. The results reveal that the proposed algorithm enhances the average accuracy by 4.35% compared with existing works. Ablation studies are also conducted to analyse the contributions of the individual techniques of the proposed algorithm, namely, the multiple rounds strategy, incremental learning, and negative transfer avoidance algorithms. These techniques enhance the average accuracy of the machine learning model by 3.44%, 0.849%, and 4.26%, respectively.(c) 2023 The Authors. Published by Elsevier Espana, S.L.U. on behalf of Journal of Innovation & Knowledge. This (http://creativecommons.org/licenses/by-nc-nd/4.0/)
引用
收藏
页数:11
相关论文
共 63 条
[1]   Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach [J].
Aerts, Hugo J. W. L. ;
Velazquez, Emmanuel Rios ;
Leijenaar, Ralph T. H. ;
Parmar, Chintan ;
Grossmann, Patrick ;
Cavalho, Sara ;
Bussink, Johan ;
Monshouwer, Rene ;
Haibe-Kains, Benjamin ;
Rietveld, Derek ;
Hoebers, Frank ;
Rietbergen, Michelle M. ;
Leemans, C. Rene ;
Dekker, Andre ;
Quackenbush, John ;
Gillies, Robert J. ;
Lambin, Philippe .
NATURE COMMUNICATIONS, 2014, 5
[2]   Unsupervised Multi-source Domain Adaptation Without Access to Source Data [J].
Ahmed, Sk Miraj ;
Raychaudhuri, Dripta S. ;
Paul, Sujoy ;
Oymak, Samet ;
Roy-Chowdhury, Amit K. .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10098-10107
[3]   Convolutional Neural Networks and Transfer Learning for Quality Inspection of Different Sugarcane Varieties [J].
Alencastre-Miranda, Moises ;
Johnson, Richard M. ;
Krebs, Hermano Igo .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) :787-794
[4]   Phishing Website Detection With Semantic Features Based on Machine Learning Classifiers: A Comparative Study [J].
Almomani, Ammar ;
Alauthman, Mohammad ;
Shatnawi, Mohd Taib ;
Alweshah, Mohammed ;
Alrosan, Ayat ;
Alomoush, Waleed ;
Gupta, Brij B. .
INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2022, 18 (01)
[5]  
Altun K, 2010, LECT NOTES COMPUT SC, V6219, P38, DOI 10.1007/978-3-642-14715-9_5
[6]   Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data [J].
Alzubaidi, Laith ;
Al-Amidie, Muthana ;
Al-Asadi, Ahmed ;
Humaidi, Amjad J. ;
Al-Shamma, Omran ;
Fadhel, Mohammed A. ;
Zhang, Jinglan ;
Santamaria, J. ;
Duan, Ye .
CANCERS, 2021, 13 (07)
[7]  
Armato SG, 2015, J MED IMAGING, V2, DOI [10.1117/1.jmi.2.2.020103, 10.1117/1.JMI.2.2.020103]
[8]   CNN-based transfer learning-BiLSTM network: A novel approach for COVID-19 infection detection [J].
Aslan, Muhammet Fatih ;
Unlersen, Muhammed Fahri ;
Sabanci, Kadir ;
Durdu, Akif .
APPLIED SOFT COMPUTING, 2021, 98
[9]   A data-centric review of deep transfer learning with applications to text data [J].
Bashath, Samar ;
Perera, Nadeesha ;
Tripathi, Shailesh ;
Manjang, Kalifa ;
Dehmer, Matthias ;
Streib, Frank Emmert .
INFORMATION SCIENCES, 2022, 585 :498-528
[10]   A comprehensive study of class incremental learning algorithms for visual tasks [J].
Belouadah, Eden ;
Popescu, Adrian ;
Kanellos, Ioannis .
NEURAL NETWORKS, 2021, 135 :38-54