A novel radial basis function neural network classifier based on three-way decisions

被引:1
作者
Li, Tengbiao [1 ]
Qiao, Junsheng [1 ,2 ]
机构
[1] Northwest Normal Univ, Coll Math & Stat, Lanzhou 730070, Peoples R China
[2] Gansu Prov Res Ctr Basic Disciplines Math & Stat, Lanzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Radial basis function neural network; Network topology; Three-way decisions; Information granule; Imbalanced classification; ALGORITHM; DESIGN;
D O I
10.1016/j.engappai.2024.109811
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The radial basis function neural network (RBFNN) has gained widespread adoption due to its simple network topology and excellent learning capability. However, the performance of empirical formula-based RBFNN tends to deteriorate when faced with sample imbalance issues. In order to fully harness the potential of RBFNN classifier, inspired by three-way decisions (TWDs) conforming to the logic of human behavior, this paper investigates a novel classifier named TWDs-RBFNN that integrates TWDs and RBFNN. This novel artificial intelligence approach efficiently handles imbalanced samples in imbalanced classification tasks while achieving enhanced performance within amore streamlined topology. TWDs-RBFNN incorporates a TWDs module into the RBFNN framework, which dynamically stores and efficiently trains difficult-to-classify samples for reinforcement learning of intricate sample information and network topology optimization through parameter updates. Drawing upon current advancements in neuroscience and granule computing theory, we introduce gradient harmonizing mechanism to balance samples at the loss function level and handle outliers to avoid parameter bias and improve training efficiency. We also introduce information granules and establish a novel conditional probability formula to safeguard against information loss. The results of numerous experiments on imbalanced datasets demonstrate that TWDs effectively enhances the compactness of the network structure and improve its generalization ability in RBFNN. Specifically, we provide theoretical proof for the convergence of TWDs-RBFNN to analyze their effectiveness.
引用
收藏
页数:17
相关论文
共 57 条
[1]   A Fast and Efficient Method for Training Categorical Radial Basis Function Networks [J].
Alexandridis, Alex ;
Chondrodima, Eva ;
Giannopoulos, Nikolaos ;
Sarimveis, Haralambos .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2831-2836
[2]   INTUITIONISTIC FUZZY-SETS [J].
ATANASSOV, KT .
FUZZY SETS AND SYSTEMS, 1986, 20 (01) :87-96
[3]   MAGNNETO: A Graph Neural Network-Based Multi-Agent System for Traffic Engineering [J].
Bernardez, Guillermo ;
Suarez-Varela, Jose ;
Lopez, Albert ;
Shi, Xiang ;
Xiao, Shihan ;
Cheng, Xiangle ;
Barlet-Ros, Pere ;
Cabellos-Aparicio, Albert .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (02) :494-506
[4]   Employing deep learning for automatic river bridge detection from SAR images based on Adaptively effective feature fusion [J].
Chen, Lifu ;
Weng, Ting ;
Xing, Jin ;
Li, Zhenhong ;
Yuan, Zhihui ;
Pan, Zhouhao ;
Tan, Siyu ;
Luo, Ru .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 102
[5]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[6]   TWD-SFNN: Three-way decisions with a single hidden layer feedforward neural network [J].
Cheng, Shuhui ;
Wu, Youxi ;
Li, Yan ;
Yao, Fang ;
Min, Fan .
INFORMATION SCIENCES, 2021, 579 :15-32
[7]   Adaptive Global Sliding-Mode Control for Dynamic Systems Using Double Hidden Layer Recurrent Neural Network Structure [J].
Chu, Yundi ;
Fei, Juntao ;
Hou, Shixi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (04) :1297-1309
[8]  
Cramer J.S., 2002, ORIGINS LOGISTIC REG, DOI [DOI 10.2139/SSRN.360300, /10.2139/ssrn.360300]
[9]   A supervised data augmentation strategy based on random combinations of key features [J].
Ding, Yongchang ;
Liu, Chang ;
Zhu, Haifeng ;
Chen, Qianjun .
INFORMATION SCIENCES, 2023, 632 :678-697
[10]  
Dozat Timothy., 2016, INCORPORATING NESTER