A Fractional Gradient Descent-Based RBF Neural Network

被引:47
作者
Khan, Shujaat [1 ]
Naseem, Imran [2 ,3 ]
Malik, Muhammad Ammar [4 ]
Togneri, Roberto [3 ]
Bennamoun, Mohammed [5 ]
机构
[1] Iqra Univ, Fac Engn Sci & Technol, Shaheed E Millat Rd Ext, Karachi 75500, Pakistan
[2] Karachi Inst Econ & Technol, Coll Engn, Karachi 75190, Pakistan
[3] Univ Western Australia, Sch Elect Elect & Comp Engn, 35 Stirling Highway, Crawley, WA 6009, Australia
[4] Chosun Univ, Dept Comp Engn, 309 Pilmun Daero, Gwangju 61452, South Korea
[5] Univ Western Australia, Sch Comp Sci & Software Engn, 35 Stirling Highway, Crawley, WA 6009, Australia
关键词
Artificial neural networks; Radial basis function; Nonlinear system identification; Time series prediction; Kernel function; Function approximation; Fractional-order calculus; modified Riemann-Liouville derivative; Wiener solution; LEARNING ALGORITHM; APPROXIMATION; DERIVATIVES; CALCULUS; MODELS;
D O I
10.1007/s00034-018-0835-3
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this research, we propose a novel fractional gradient descent-based learning algorithm (FGD) for the radial basis function neural networks (RBF-NN). The proposed FGD is the convex combination of the conventional, and the modified Riemann-Liouville derivative-based fractional gradient descent methods. The proposed FGD method is analyzed for an optimal solution in a system identification problem, and a closed form Wiener solution of a least square problem is obtained. Using the FGD, the weight update rule for the proposed fractional RBF-NN (FRBF-NN) is derived. The proposed FRBF-NN method is shown to outperform the conventional RBF-NN on four major problems of estimation namely nonlinear system identification, pattern classification, time series prediction and function approximation.
引用
收藏
页码:5311 / 5332
页数:22
相关论文
共 66 条
[1]   A Novel Kernel for RBF Based Neural Networks [J].
Aftab, Wasim ;
Moinuddin, Muhammad ;
Shaikh, Muhammad Shafique .
ABSTRACT AND APPLIED ANALYSIS, 2014,
[2]   A Fast and Efficient Method for Training Categorical Radial Basis Function Networks [J].
Alexandridis, Alex ;
Chondrodima, Eva ;
Giannopoulos, Nikolaos ;
Sarimveis, Haralambos .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2831-2836
[3]   Cooperative learning for radial basis function networks using particle swarm optimization [J].
Alexandridis, Alex ;
Chondrodima, Eva ;
Sarimveis, Haralambos .
APPLIED SOFT COMPUTING, 2016, 49 :485-497
[4]   A fast online learning algorithm of radial basis function network with locality sensitive hashing [J].
Ali S.H.A. ;
Fukase K. ;
Ozawa S. .
Evolving Systems, 2016, 7 (03) :173-186
[5]   Training radial basis function networks using biogeography-based optimizer [J].
Aljarah, Ibrahim ;
Faris, Hossam ;
Mirjalili, Seyedali ;
Al-Madi, Nailah .
NEURAL COMPUTING & APPLICATIONS, 2018, 29 (07) :529-553
[6]  
An R, 2016, CHIN CONTR CONF, P3630, DOI 10.1109/ChiCC.2016.7553917
[7]  
ANDERSON EDGAR, 1936, ANN MISSOURI BOT GARD, V23, P457, DOI 10.2307/2394164
[8]  
[Anonymous], 1994, Neural Networks: A Comprehensive Foundation
[9]  
[Anonymous], ARXIV171206096
[10]  
[Anonymous], ADV NEURAL INFORM PR