A Modified Gradient-based Backpropagation Training Method for Neural Networks

被引：0
|
作者：
Mu, Xuewen [1 ]
Zhang, Yaling [2 ]
机构：
[1] Xidian Univ, Dept Appl Math, Xian 710071, Peoples R China
[2] Xian Sci & Technol Univ, Dept Comp Sci, Xian 710054, Peoples R China
来源：
2009 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING ( GRC 2009) | 2009年
关键词：
Barzilai and Borwein steplength; Resilient Propagation method; backpropagation training method;
D O I：
10.1109/GRC.2009.5255081
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
A improved gradient-based backpropagation training method is proposed for neural networks in this paper. Based on the Barzilai and Borwein steplength update and some technique of Resilient Propagation method, we adapt the new learning rate to improves the speed and the success rate. Experimental results show that the proposed method has considerably improved convergence speed, and for the chosen test problems, outperforms other well-known training methods.
引用
收藏
页码：450 / +
页数：2
相关论文
共 50 条
  • [1] A New Two-Step Gradient-Based Backpropagation Training Method for Neural Networks
    Mu, Xuewen
    Zhang, Yaling
    ADVANCES IN NEURAL NETWORKS - ISNN 2010, PT 1, PROCEEDINGS, 2010, 6063 : 95 - +
  • [2] Parallel implementation of gradient-based neural networks for SVM training
    Ferreira, Leonardo V.
    Kaszkurewicz, Eugenius
    Bhaya, Amit
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 339 - +
  • [3] A Modified Backpropagation Training Algorithm for Feedforward Neural Networks*
    T. Kathirvalavakumar
    P. Thangavel
    Neural Processing Letters, 2006, 23 : 111 - 119
  • [4] A modified backpropagation training algorithm for feedforward neural networks
    Kathirvalavakumar, T
    Thangavel, P
    NEURAL PROCESSING LETTERS, 2006, 23 (02) : 111 - 119
  • [5] Generalizing Backpropagation for Gradient-Based Interpretability
    Du, Kevin
    Hennigen, Lucas Torroba
    Stoehr, Niklas
    Warstadt, Alexander
    Cotterel, Ryan
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 11979 - 11995
  • [6] Structural optimization by gradient-based neural networks
    Iranmanesh, A
    Kaveh, A
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 1999, 46 (02) : 297 - 311
  • [7] Gradient-based PIV using neural networks
    I. Kimura
    Y. Susaki
    R. Kiyohara
    A. Kaga
    Y. Kuroe
    Journal of Visualization, 2002, 5 : 363 - 370
  • [8] Gradient-based PIV using neural networks
    Kimura, I
    Susaki, Y
    Kiyohara, R
    Kaga, A
    Kuroe, Y
    JOURNAL OF VISUALIZATION, 2002, 5 (04) : 363 - 370
  • [9] Training of photonic neural networks through in situ backpropagation and gradient measurement
    Hughes, Tyler W.
    Minkov, Momchil
    Shi, Yu
    Fan, Shanhui
    OPTICA, 2018, 5 (07): : 864 - 871
  • [10] A New Correntropy-Based Conjugate Gradient Backpropagation Algorithm for Improving Training in Neural Networks
    Heravi, Ahmad Reza
    Hodtani, Ghosheh Abed
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) : 6252 - 6263
12345