A Source Domain Extension Method for Inductive Transfer Learning Based on Flipping Output

被引:1
作者
Koishi, Yasutake [1 ]
Ishida, Shuichi [1 ]
Tabaru, Tatsuo [1 ]
Miyamoto, Hiroyuki [2 ]
机构
[1] Natl Inst Adv Ind Sci & Technol, Adv Mfg Res Inst, Saga 8410052, Japan
[2] Kyushu Inst Technol Kyutech, Grad Sch Life Sci & Syst Engn, Fukuoka, Fukuoka 8080196, Japan
关键词
transfer learning; ensemble learning; data expansion; flipping output;
D O I
10.3390/a12050095
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transfer learning aims for high accuracy by applying knowledge of source domains for which data collection is easy in order to target domains where data collection is difficult, and has attracted attention in recent years because of its significant potential to enable the application of machine learning to a wide range of real-world problems. However, since the technique is user-dependent, with data prepared as a source domain which in turn becomes a knowledge source for transfer learning, it often involves the adoption of inappropriate data. In such cases, the accuracy may be reduced due to negative transfer. Thus, in this paper, we propose a novel transfer learning method that utilizes the flipping output technique to provide multiple labels in the source domain. The accuracy of the proposed method is statistically demonstrated to be significantly better than that of the conventional transfer learning method, and its effect size is as high as 0.9, showing high performance.
引用
收藏
页数:12
相关论文
共 16 条
[1]  
[Anonymous], 2007, PROC 24 INT C MACHIN, DOI DOI 10.1145/1273496.1273521
[2]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[3]   Randomizing outputs to increase prediction accuracy [J].
Breiman, L .
MACHINE LEARNING, 2000, 40 (03) :229-242
[4]  
Breiman L., 1996, ANN STAT, V26, P824
[5]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[6]   A POWER PRIMER [J].
COHEN, J .
PSYCHOLOGICAL BULLETIN, 1992, 112 (01) :155-159
[7]  
Daume III H., 2007, P 45 ANN M ASS COMPU, P256
[8]   A decision-theoretic generalization of on-line learning and an application to boosting [J].
Freund, Y ;
Schapire, RE .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1997, 55 (01) :119-139
[9]  
Hal D., 2010, P 2010 WORKSH DOM AD, P53
[10]   Deep Neural Networks for Acoustic Modeling in Speech Recognition [J].
Hinton, Geoffrey ;
Deng, Li ;
Yu, Dong ;
Dahl, George E. ;
Mohamed, Abdel-rahman ;
Jaitly, Navdeep ;
Senior, Andrew ;
Vanhoucke, Vincent ;
Patrick Nguyen ;
Sainath, Tara N. ;
Kingsbury, Brian .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :82-97