Unsupervised kernel least mean square algorithm for solving ordinary differential equations

被引:45
作者
Yazdi, Hadi Sadoghi [1 ]
Pakdaman, Morteza [2 ]
Modaghegh, Hamed [1 ]
机构
[1] Ferdowsi Univ Mashhad, Dept Engn, Mashhad, Iran
[2] Islamic Azad Univ, Sama Tech & Vocat Training Coll, Mashhad Branch, Mashhad, Iran
关键词
Unsupervised learning; Kernel least mean square; Ordinary differential equation; Neuro-fuzzy approach; NEURAL-NETWORKS; NUMERICAL-SOLUTION;
D O I
10.1016/j.neucom.2010.12.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper a novel method is introduced based on the use of an unsupervised version of kernel least mean square (KLMS) algorithm for solving ordinary differential equations (ODES). The algorithm is unsupervised because here no desired signal needs to be determined by user and the output of the model is generated by iterating the algorithm progressively. However, there are several new approaches in literature to solve ODEs but the new approach has more advantages such as simple implementation, fast convergence and also little error. Furthermore, it is also a KLMS with obvious characteristics. In this paper the ability of KLMS is used to estimate the answer of ODE. First a trial solution of ODE is written as a sum of two parts, the first part satisfies the initial condition and the second part is trained using the KLMS algorithm so as the trial solution solves the ODE. The accuracy of the method is illustrated by solving several problems. Also the sensitivity of the convergence is analyzed by changing the step size parameters and kernel functions. Finally, the proposed method is compared with neuro-fuzzy [21] approach. Crown Copyright (C) 2011 Published by Elsevier B.V. All rights reserved,
引用
收藏
页码:2062 / 2071
页数:10
相关论文
共 34 条
[1]  
[Anonymous], 2002, Journal of machine learning research
[2]  
BAO H, 2009, IEEE 43 AS C SIGN SY, P642
[3]   Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques [J].
Beidokhti, R. Shekari ;
Malek, A. .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2009, 346 (09) :898-913
[4]  
Brause R, 2003, P 15 IEEE INT C TOOL
[5]   COMPARING PREDICTIVE ACCURACY [J].
DIEBOLD, FX ;
MARIANO, RS .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 1995, 13 (03) :253-263
[6]   Artificial neural network approach for solving fuzzy differential equations [J].
Effati, Sohrab ;
Pakdaman, Morteza .
INFORMATION SCIENCES, 2010, 180 (08) :1434-1457
[7]  
GHAFARIAN SH, 2010, INT J COMPUTER THEOR, V2, P1793
[8]   REGULARIZATION THEORY AND NEURAL NETWORKS ARCHITECTURES [J].
GIROSI, F ;
JONES, M ;
POGGIO, T .
NEURAL COMPUTATION, 1995, 7 (02) :219-269
[9]  
Gunduz A, 2009, P 4 INT IEEE EMBS C
[10]  
GUNDUZ A, 2009, 4 INT IEEE EMBS C NE, V9, P267