NOVEL FAST TRAINING ALGORITHM FOR MULTILAYER FEEDFORWARD NEURAL NETWORK

被引：9
作者：
PARK, DJ
JUN, BE
KIM, JH
机构：
[1] Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Taejon 305-701, 373-1 Kusong-dong, Yusung-gu
来源：
ELECTRONICS LETTERS | 1992年 / 28卷 / 06期
关键词：
NEURAL NETWORKS; ALGORITHMS;
D O I：
10.1049/el:19920343
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
A new fast learning algorithm for a multilayer feedforward neural network is presented. The new algorithm, based on an innovative variable step size and gradient averaging, has excellent properties to overcome major drawbacks of the backpropagation algorithm and shows high convergence speed. The improved performance of the new algorithm in comparison with other algorithms is verified via computer simulations.
引用
收藏
页码：543 / 545
页数：3
相关论文
共 50 条
[31]   A novel neural network training framework with data assimilation [J].
Chen, Chong ;
Dou, Yixuan ;
Chen, Jie ;
Xue, Yaru .
JOURNAL OF SUPERCOMPUTING, 2022, 78 (17) :19020-19045
[32]   AN IMPROVED SPECTRAL CONJUGATE GRADIENT NEURAL NETWORK TRAINING ALGORITHM [J].
Livieris, Ioannis E. ;
Pintelas, Panagiotis .
INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2012, 21 (01)
[33]   A Feedforward Neural Network Wheelchair Driving Joystick [J].
Rabhi, Yassine ;
Mrabet, Makrem ;
Fnaiech, Farhat ;
Gorce, Philippe .
2013 INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND SOFTWARE APPLICATIONS (ICEESA), 2013, :593-598
[34]   Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs [J].
You, Yang ;
Zhang, Zhao ;
Hsieh, Cho-Jui ;
Demmel, James ;
Keutzer, Kurt .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (11) :2449-2462
[35]   Training feedforward neural networks using neural networks and genetic algorithms [J].
Tellez, P ;
Tang, Y .
INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS AND CONTROL TECHNOLOGIES, VOL 1, PROCEEDINGS, 2004, :308-311
[36]   Optimal Parameter for the Training of Multilayer Perceptron Neural Networks by Using Hierarchical Genetic Algorithm [J].
Orozco-Monteagudo, Maykel ;
Taboada-Crispi, Alberto ;
Gutierrez-Hernandez, Liliana .
INTERNATIONAL ELECTRONIC CONFERENCE ON COMPUTER SCIENCE, 2008, 1060 :3-6
[37]   Classification of normal and abnormal electrogastrograms using multilayer feedforward neural networks [J].
Z. Lin ;
J. Maris ;
L. Hermans ;
J. Vandewalle ;
J. D. Z. Chen .
Medical and Biological Engineering and Computing, 1997, 35 :199-206
[38]   The quantization effects of different probability distribution on multilayer feedforward neural networks [J].
Jiang, MH ;
Gielen, G ;
Deng, BX ;
Tang, XF ;
Ruan, QQ ;
Yuan, BZ .
2002 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I AND II, 2002, :1175-1178
[39]   Classification of normal and abnormal electrogastrograms using multilayer feedforward neural networks [J].
Lin, Z ;
Maris, J ;
Hermans, L ;
Vandewalle, J ;
Chen, JDZ .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 1997, 35 (03) :199-206
[40]   Use of multilayer feedforward neural networks in identification and control of Wiener model [J].
AlDuwaish, H ;
Karim, MN ;
Chandrasekar, V .
IEE PROCEEDINGS-CONTROL THEORY AND APPLICATIONS, 1996, 143 (03) :255-258
12345