Optimization-based learning with bounded error for feedforward neural networks

被引:16
作者
Alessandri, A [1 ]
Sanguineti, M
Maggiore, M
机构
[1] Natl Res Council Italy, Naval Automat Inst, IAN CNR, I-16149 Genoa, Italy
[2] Univ Genoa, DIST, Dept Commun Comp & Syst Sci, I-16145 Genoa, Italy
[3] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S 3G4, Canada
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 02期
关键词
feedforward neural networks; learning algorithms; nonlinear programming; optimization;
D O I
10.1109/72.991413
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An optimization-based learning algorithm for feedforward neural networks is presented, in which the network weights are determined by minimizing a sliding-window cost. The algorithm is particularly well suited for batch learning and allows one to deal with large data sets in a computationally efficient way. An analysis of its convergence and robustness properties is made. Simulation results confirm the effectiveness of the algorithm and its advantages over learning based on backpropagation and extended Kalman filter.
引用
收藏
页码:261 / 273
页数:13
相关论文
共 30 条
[1]   A neural state estimator with bounded errors for nonlinear systems [J].
Alessandri, A ;
Baglietto, M ;
Parisini, T ;
Zoppoli, R .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1999, 44 (11) :2028-2042
[2]   Neural approximators for nonlinear finite-memory state estimation [J].
Alessandri, A ;
Parisini, T ;
Zoppoli, R .
INTERNATIONAL JOURNAL OF CONTROL, 1997, 67 (02) :275-301
[3]   The effects of adding noise during backpropagation training on a generalization performance [J].
An, GZ .
NEURAL COMPUTATION, 1996, 8 (03) :643-674
[4]   UNIVERSAL APPROXIMATION BOUNDS FOR SUPERPOSITIONS OF A SIGMOIDAL FUNCTION [J].
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :930-945
[5]   1ST-ORDER AND 2ND-ORDER METHODS FOR LEARNING - BETWEEN STEEPEST DESCENT AND NEWTON METHOD [J].
BATTITI, R .
NEURAL COMPUTATION, 1992, 4 (02) :141-166
[6]   EXPERIMENTS ON NEURAL NET RECOGNITION OF SPOKEN AND WRITTEN TEXT [J].
BURR, DJ .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1988, 36 (07) :1162-1168
[7]   THE RELATIONSHIP BETWEEN ERYTHROCYTE AGE AND CELL CONTENT OF MICRONUTRIENTS AND LEVELS OF RELATED ENZYMES [J].
CHU, RC ;
BEGLEY, JA ;
HALL, CA .
NUTRITION RESEARCH, 1990, 10 (01) :31-37
[8]   A comparison of nonlinear optimization methods for supervised learning in multilayer feedforward neural networks [J].
Denton, JW ;
Hung, MS .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1996, 93 (02) :358-368
[9]  
Fletcher R., 1981, PRACTICAL METHODS OP
[10]   REGULARIZATION THEORY AND NEURAL NETWORKS ARCHITECTURES [J].
GIROSI, F ;
JONES, M ;
POGGIO, T .
NEURAL COMPUTATION, 1995, 7 (02) :219-269