A novel progressive learning technique for multi-class classification

被引:27
作者
Venkatesan, Rajasekar [1 ]
Er, Meng Joo [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
关键词
Classification; Machine learning; Multi-class; Sequential learning; Progressive learning; FEEDFORWARD NETWORKS; FUNCTION APPROXIMATION; NEURAL-NETWORK; MACHINE; ALGORITHM; REGRESSION; SYSTEM;
D O I
10.1016/j.neucom.2016.05.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a progressive learning technique for multi-class classification is proposed. This newly developed learning technique is independent of the number of class constraints and it can learn new classes while still retaining the knowledge of previous Classes. Whenever a new class (non-native to the knowledge learnt thus far) is encountered, the neural network structure gets remodeled automatically by facilitating new neurons and interconnections, and the parameters are calculated in such a way that it retains the knowledge learnt thus far. This technique is suitable for real-world applications where the number of classes is often unknown and online learning from real-time data is required. The consistency and the complexity of the progressive learning technique are analyzed. Several standard datasets are used to evaluate the performance of the developed technique. A comparative study shows that the developed technique is superior. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:310 / 321
页数:12
相关论文
共 43 条
[1]   A new automatic target recognition system based on wavelet extreme learning machine [J].
Avci, Engin ;
Coteli, Resul .
EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (16) :12340-12348
[2]   Voting based extreme learning machine [J].
Cao, Jiuwen ;
Lin, Zhiping ;
Huang, Guang-Bin ;
Liu, Nan .
INFORMATION SCIENCES, 2012, 185 (01) :66-77
[3]   ORTHOGONAL LEAST-SQUARES LEARNING ALGORITHM FOR RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
COWAN, CFN ;
GRANT, PM .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (02) :302-309
[4]   A Hybrid Automatic System for the Diagnosis of Lung Cancer Based on Genetic Algorithm and Fuzzy Extreme Learning Machines [J].
Daliri, Mohammad Reza .
JOURNAL OF MEDICAL SYSTEMS, 2012, 36 (02) :1001-1005
[5]   Smooth function approximation using neural networks [J].
Ferrari, S ;
Stengel, RF .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (01) :24-38
[6]   Parameter-insensitive kernel in extreme learning for non-linear support vector regression [J].
Frenay, Benoit ;
Verleysen, Michel .
NEUROCOMPUTING, 2011, 74 (16) :2526-2531
[7]   TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM [J].
HAGAN, MT ;
MENHAJ, MB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (06) :989-993
[8]   Trends in extreme learning machines: A review [J].
Huang, Gao ;
Huang, Guang-Bin ;
Song, Shiji ;
You, Keyou .
NEURAL NETWORKS, 2015, 61 :32-48
[9]  
Huang GB, 2005, PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE, P232
[10]   A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation [J].
Huang, GB ;
Saratchandran, P ;
Sundararajan, N .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (01) :57-67