A fast learning algorithm of neural network with tunable activation function

被引:0
作者
SHEN Yanjun
机构
关键词
neural networks; RLS algorithm; TAF neural model; learning algorithm;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a modified structure of a neural network with tunable activation function and provides a new learning algorithm for the neural network training. Simulation results of XOR problem, Feigenbaum function, and Henon map show that the new algorithm has better performance than BP (back propagation) algorithm in terms of shorter convergence time and higher convergence accuracy. Further modifications of the structure of the neural network with the faster learning algorithm demonstrate simpler structure with even faster convergence speed and better convergence accuracy.
引用
收藏
页码:126 / 136
页数:11
相关论文
共 12 条
  • [1] A New Perceptron Model with Tumable Activation Function. Wu YouShou,Zhao MingSheng,Ding XiaoQing. The Chinese Journal . 1996
  • [2] Fast learning process of multilayer neural networks using recursive least squares method. M. R. Azimi-Sadjadi,R.-J. Liou. IEEE Transactions on Signal Processing . 1992
  • [3] The research on constructing some group neural networks by the known input signal. Y. S. Wu. Science in China . 1996
  • [4] Adapt Filter Theory. S. Haykin. . 1986
  • [5] A Gaussian potential function network with hierarchically self-organizing learning. S Lee,RM Kil. Neural Networks . 1991
  • [6] NEURAL NETWORKS[P]. COLLINGS NEIL.英国专利:GB2231989B,1993-10-06
  • [7] How to solve the N-bit parity problem with two hidden units. D. G. Stork,J. D. Allen. Neural Networks . 1992
  • [8] A fast new algorithm for training feedforward neural networks. R. S. Scalero,N. Tepedelenlioglu. IEEE Transactions on Signal Processing . 1992
  • [9] Parallel Distributed Processing, Vol. 1. D. E. Rumelhart,J. L. McClelland. . 1986
  • [10] A New Perceptron Model with Tumable Activation Function. Wu YouShou,Zhao MingSheng,Ding XiaoQing. The Chinese Journal . 1996