Optimization of self-organizing polynomial neural networks

被引:15
作者
Maric, Ivan [1 ]
机构
[1] Rudjer Boskovic Inst, Zagreb 10000, Croatia
关键词
Polynomial neural networks; GMDH; Levenberg-Marquardt algorithm; Particle swarm optimization; Time series modeling; ECHO STATE NETWORKS; FUNCTION APPROXIMATION; COMPENSATION;
D O I
10.1016/j.eswa.2013.01.060
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The main disadvantage of self-organizing polynomial neural networks (SOPNN) automatically structured and trained by the group method of data handling (GMDH) algorithm is a partial optimization of model weights as the GMDH algorithm optimizes only the weights of the topmost (output) node. In order to estimate to what extent the approximation accuracy of the obtained model can be improved the particle swarm optimization (PSO) has been used for the optimization of weights of all node-polynomials. Since the PSO is generally computationally expensive and time consuming a more efficient Levenberg-Marquardt (LM) algorithm is adapted for the optimization of the SOPNN. After it has been optimized by the LM algorithm the SOPNN outperformed the corresponding models based on artificial neural networks (ANN) and support vector method (SVM). The research is based on the meta-modeling of the thermodynamic effects in fluid flow measurements with time-constraints. The outstanding characteristics of the optimized SOPNN models are also demonstrated in learning the recurrence relations of multiple superimposed oscillations (MSO). (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:4528 / 4538
页数:11
相关论文
共 20 条
  • [1] [Anonymous], ISO51672
  • [2] Recurrent sparse support vector regression machines trained by active learning in the time-domain
    Ceperic, V.
    Gielen, G.
    Baric, A.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (12) : 10933 - 10942
  • [3] Chapra S.C., 1998, NUMERICAL METHODS EN, V3rd
  • [4] Eberhart R., 1995, MHS 95, P39, DOI [DOI 10.1109/MHS.1995.494215, 10.1109/MHS.1995.494215]
  • [5] Smooth function approximation using neural networks
    Ferrari, S
    Stengel, RF
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (01): : 24 - 38
  • [6] Echo state networks with filter neurons and a delay&sum readout
    Holzmann, Georg
    Hauser, Helmut
    [J]. NEURAL NETWORKS, 2010, 23 (02) : 244 - 256
  • [7] ISO, 2005, ISO20765-1
  • [8] POLYNOMIAL THEORY OF COMPLEX SYSTEMS
    IVAKHNENKO, AG
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1971, SMC1 (04): : 364 - +
  • [9] GMDH-based modeling and feedforward compensation for nonlinear friction in table drive systems
    Iwasaki, M
    Takei, H
    Matsui, N
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2003, 50 (06) : 1172 - 1178
  • [10] Jin R., 2000, AIAA USAF NASA ISSMO