An online learning algorithm for a neuro-fuzzy classifier with mixed-attribute data

被引:6
作者
Khuat, Thanh Tung [1 ]
Gabrys, Bogdan [1 ]
机构
[1] Univ Technol Sydney, Data Sci Inst, Complex Adapt Syst Lab, Sydney, NSW, Australia
关键词
General fuzzy min-max neural network; Classification; Mixed-attribute data; Online learning; Neuro-fuzzy classifier; NETWORK; MODELS;
D O I
10.1016/j.asoc.2023.110152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
General fuzzy min-max neural network (GFMMNN) is one of the efficient neuro-fuzzy systems for data classification. However, one of the downsides of its original learning algorithms is the inability to handle and learn directly from mixed-attribute data without using encoding techniques. While categorical feature encoding methods can be used with the GFMMNN learning algorithms, they exhibit many shortcomings. Other improved approaches proposed in the literature are not suitable for online learning algorithms working in the dynamically changing environments without ability to retrain or access full historical data, which are usually required for many real world applications. This paper proposes an extended online learning algorithm for the GFMMNN. The proposed method can handle the datasets with both continuous and categorical features. It uses the change in the entropy values of categorical features of the samples contained in a hyperbox to determine if the current hyperbox can be expanded to include the categorical values of a new training instance. An extended architecture of the original GFMMNN and its new membership function are introduced for mixed-attribute data. Important mathematical properties of the proposed learning algorithms are also presented and proved in this paper. The extensive experiments confirmed superior and stable classification performance of the proposed approach in comparison to other relevant learning algorithms for the GFMM model. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 45 条
[1]  
[Anonymous], 2001, PATTERN CLASSIFICATI, DOI DOI 10.1007/978-1-4471-0285-4_9
[2]  
Bargiela A., 2004, International Journal of Knowledge-Based and Intelligent Engineering Systems, V8, P91
[3]   A feed-forward network for input that is both categorical and quantitative [J].
Brouwer, RK .
NEURAL NETWORKS, 2002, 15 (07) :881-890
[4]   FUZZY ART - FAST STABLE LEARNING AND CATEGORIZATION OF ANALOG PATTERNS BY AN ADAPTIVE RESONANCE SYSTEM [J].
CARPENTER, GA ;
GROSSBERG, S ;
ROSEN, DB .
NEURAL NETWORKS, 1991, 4 (06) :759-771
[5]   ARTMAP - SUPERVISED REAL-TIME LEARNING AND CLASSIFICATION OF NONSTATIONARY DATA BY A SELF-ORGANIZING NEURAL NETWORK [J].
CARPENTER, GA ;
GROSSBERG, S ;
REYNOLDS, JH .
NEURAL NETWORKS, 1991, 4 (05) :565-588
[6]  
Crowder JA, 2020, Artificial psychology: Psychological modeling and testing of AI systems, P129
[7]  
de Campos Souza P.V., 2022, EFNN NULLUNI EVOLVIN
[8]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[9]  
Eastwood M., 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2011), P443, DOI 10.1109/FSKD.2011.6019563
[10]  
Fernández-Delgado M, 2014, J MACH LEARN RES, V15, P3133