A training algorithm with selectable search direction for complex-valued feedforward neural networks

被引:16
作者
Dong, Zhongying [1 ]
Huang, He [1 ]
机构
[1] Soochow Univ, Sch Elect & Informat Engn, Suzhou 215006, Peoples R China
关键词
Complex-valued feedforward neural networks; Selectable search direction; Direction factors; Efficient training; Tree structure; CONJUGATE-GRADIENT METHOD; BACKPROPAGATION ALGORITHM; DETERMINISTIC CONVERGENCE;
D O I
10.1016/j.neunet.2021.01.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper focuses on presenting an efficient training algorithm for complex-valued feedforward neural networks by utilizing a tree structure. The basic idea of the proposed algorithm is that, by introducing a set of direction factors, distinctive search directions are available to be selected at each iteration such that the objective function is reduced as much as possible. Compared with some well-known training algorithms, one of the advantages of our algorithm is that the determination of search direction is of great flexibility and thus more accurate solution is obtained with faster convergence speed. Experimental simulations on pattern recognition, channel equalization and complex function approximation are provided to verify the effectiveness and applications of the proposed algorithm. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:75 / 84
页数:10
相关论文
共 39 条
  • [1] The performance of the backpropagation algorithm with varying slope of the activation function
    Bai, Yanping
    Zhang, Haixia
    Hao, Yilong
    [J]. CHAOS SOLITONS & FRACTALS, 2009, 40 (01) : 69 - 77
  • [2] ON THE COMPLEX BACKPROPAGATION ALGORITHM
    BENVENUTO, N
    PIAZZA, F
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (04) : 967 - 968
  • [3] SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivation
    Blewitt, Marnie E.
    Gendrel, Anne-Valerie
    Pang, Zhenyi
    Sparrow, Duncan B.
    Whitelaw, Nadia
    Craig, Jeffrey M.
    Apedaile, Anwyn
    Hilton, Douglas J.
    Dunwoodie, Sally L.
    Brockdorff, Neil
    Kay, Graham F.
    Whitelaw, Emma
    [J]. NATURE GENETICS, 2008, 40 (05) : 663 - 669
  • [4] CHANNEL EQUALIZATION USING ADAPTIVE COMPLEX RADIAL BASIS FUNCTION NETWORKS
    CHA, I
    KASSAM, SA
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1995, 13 (01) : 122 - 131
  • [5] Chang C.-C., 2011, ACM T INTEL SYST TEC, V2, P1, DOI DOI 10.1145/1961189.1961199
  • [6] Dua D, 2017, UCI MACHINE LEARNING, DOI DOI 10.1016/J.DSS.2009.05.016
  • [7] FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS
    FLETCHER, R
    REEVES, CM
    [J]. COMPUTER JOURNAL, 1964, 7 (02) : 149 - &
  • [8] Gopalakrishnan S., 2019, ARXIV PREPRINT ARXIV
  • [9] Hager W.W., 2006, Pac. J. Optim, V2, P35
  • [10] A new conjugate gradient method with guaranteed descent and an efficient line search
    Hager, WW
    Zhang, HC
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2005, 16 (01) : 170 - 192