Incremental learning framework for function approximation, via combining mixture of expert model and adaptive resonance theory

被引:0
作者
Kim, Cheoltaek [1 ]
Lee, Ju-Jang [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Comp Sci & Elect Engn, Taejon 305701, South Korea
来源
2007 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS I-V, CONFERENCE PROCEEDINGS | 2007年
关键词
function approximation; incremental learning; adaptive resonance theory; mixture of experts; multilayer perceptron;
D O I
10.1109/ICMA.2007.4304124
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces an incremental learning framework for function approximation which uses the structure of mixture of expert model and learning methodology of adaptive resonance theory. The proposed framework adapts their structure and parameter. values through incremental, competitive learning, and supervised learning. The main idea comes from that the combination of two classical methods which are mixture of expert model and adaptive resonance theory can be jointly learned and the combination keeps up the advantages of each method;the mixture of expert model has the ability to avoid strong interference and the adaptive resonance theory is one of the best model of incremental learning. The idea can be implemented by modifying adaptive resonance theory based on the mixture of expert model. The empirical experiment would show the performance of the proposed implementation via comparing receptive field weighted regression(RFWR) and PROBART.
引用
收藏
页码:3486 / 3491
页数:6
相关论文
共 11 条
[1]  
[Anonymous], 2005, NEURAL NETWORKS CLAS
[2]  
Farrell J. A., 2006, ADAPTIVE APPROXIMATI
[3]  
Grossberg S., 2000, CASCNS2000024 BOST U
[4]   Adaptive Mixtures of Local Experts [J].
Jacobs, Robert A. ;
Jordan, Michael I. ;
Nowlan, Steven J. ;
Hinton, Geoffrey E. .
NEURAL COMPUTATION, 1991, 3 (01) :79-87
[5]  
LECUN Y, 1998, LNCS, V1524
[6]   A MODIFIED FUZZY ARTMAP ARCHITECTURE FOR THE APPROXIMATION OF NOISY MAPPINGS [J].
MARRIOTT, S ;
HARRISON, RF .
NEURAL NETWORKS, 1995, 8 (04) :619-641
[7]   Structurally adaptive modular networks for nonstationary environments [J].
Ramamurti, V ;
Ghosh, J .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (01) :152-160
[8]   Constructive incremental learning from only local information [J].
Schaal, S ;
Atkeson, CG .
NEURAL COMPUTATION, 1998, 10 (08) :2047-2084
[9]   Implementing online natural gradient learning: Problems and solutions [J].
Wan, WS .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (02) :317-329
[10]   Gaussian ARTMAP: A neural network for past incremental learning of noisy multidimensional maps [J].
Williamson, JR .
NEURAL NETWORKS, 1996, 9 (05) :881-897