HIGHLY ROBUST TRAINING OF REGULARIZED RADIAL BASIS FUNCTION NETWORKS

被引:0
|
作者
Kalina, Jan [1 ,2 ]
Vidnerova, Petra [2 ]
Janacek, Patrik
机构
[1] Czech Acad Sci, Inst Comp Sci, Pod Vodairenskou vezi 2, Prague 8, Czech Republic
[2] Czech Acad Sci, Inst Informat Theory & Automat, Pod Vodairenskou vezi 4, Prague 8, Czech Republic
关键词
regression neural networks; robust training; effective regularization; quantile regression; robustness; REGRESSION QUANTILES; LEARNING ALGORITHM; RBF; SQUARES;
D O I
10.14736/kyb-2024-1-0038
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Radial basis function (RBF) networks represent established tools for nonlinear regression modeling with numerous applications in various fields. Because their standard training is vulnerable with respect to the presence of outliers in the data, several robust methods for RBF network training have been proposed recently. This paper is interested in robust regularized RBF networks. A robust inter-quantile version of RBF networks based on trimmed least squares is proposed here. Then, a systematic comparison of robust regularized RBF networks follows, which is evaluated over a set of 405 networks trained using various combinations of robustness and regularization types. The experiments proceed with a particular focus on the effect of variable selection, which is performed by means of a backward procedure, on the optimal number of RBF units. The regularized inter-quantile RBF networks based on trimmed least squares turn out to outperform the competing approaches in the experiments if a highly robust prediction error measure is considered.
引用
收藏
页码:38 / 59
页数:22
相关论文
共 50 条
  • [1] Robust Training of Radial Basis Function Neural Networks
    Kalina, Jan
    Vidnerova, Petra
    ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 113 - 124
  • [2] ROBUST TRAINING OF RADIAL BASIS NETWORKS
    Rudenko, O. G.
    Bezsonov, O. O.
    CYBERNETICS AND SYSTEMS ANALYSIS, 2011, 47 (06) : 863 - 870
  • [3] Robust radial basis function neural networks
    Lee, CC
    Chung, PC
    Tsai, JR
    Chang, CI
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1999, 29 (06): : 674 - 685
  • [4] Adaptive Learning for Robust Radial Basis Function Networks
    Seghouane, Abd-Krim
    Shokouhi, Navid
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (05) : 2847 - 2856
  • [5] Robust centre location in radial basis function networks
    Pillati, M
    Calò, DG
    ADVANCES IN MULTIVARIATE DATA ANALYSIS, 2004, : 121 - 132
  • [6] Robust object tracking with radial basis function networks
    Babu, R. Venkatesh
    Suresh, S.
    Makur, Anamitra
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PTS 1-3, PROCEEDINGS, 2007, : 937 - +
  • [7] Nonlinear regression modeling via regularized radial basis function networks
    Ando, Tomohiro
    Konishi, Sadanori
    Imoto, Seiya
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2008, 138 (11) : 3616 - 3633
  • [8] QUANTUM SPEEDUP OF TRAINING RADIAL BASIS FUNCTION NETWORKS
    Shao, Changpeng
    QUANTUM INFORMATION & COMPUTATION, 2019, 19 (7-8) : 609 - 625
  • [9] Training Radial Basis Function networks with Differential Evolution
    Yu, Bing
    He, Xingshi
    2006 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING, 2006, : 369 - +
  • [10] Alternating minimization training of radial basis function networks
    Szymanski, PT
    Lemmon, M
    APPLICATIONS AND SCIENCE OF ARTIFICIAL NEURAL NETWORKS II, 1996, 2760 : 14 - 25