Matrix-update for accelerated on-line learning in multilayer neural networks

被引：2

作者：

Bos, S ^{[1
]}

机构：

[1] RIKEN, Lab Informat Synth, Brain Sci Inst, Wako, Saitama 35101, Japan

来源：

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 1998年 / 31卷 / 22期

关键词：

D O I：

10.1088/0305-4470/31/22/002

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

In this letter we re-examine the emergence of plateaus or symmetric phases in online learning of a committee machine. We propose a simple matrix-update in order to avoid the symmetric phase. Simulations show that the length of the plateaus can be considerably decreased. Annealing of the learning rate can then be applied much earlier, making on-line learning more effective.

引用

页码：L413 / L417

页数：5

共 50 条

[21] A New Probabilistic Approach to On-Line Learning in Artificial Neural Networks
Jankovic, Marko V.
Rubens, Neil
PROCEEDINGS OF THE 3RD INT CONF ON APPLIED MATHEMATICS, CIRCUITS, SYSTEMS, AND SIGNALS/PROCEEDINGS OF THE 3RD INT CONF ON CIRCUITS, SYSTEMS AND SIGNALS, 2009, : 226 - +
[22] On-line Gibbs learning. II. Application to perceptron and multilayer networks
Kim, JW
Sompolinsky, H
PHYSICAL REVIEW E, 1998, 58 (02) : 2348 - 2362
[23] AN ACCELERATED LEARNING ALGORITHM FOR MULTILAYER PERCEPTRON NETWORKS
PARLOS, AG
FERNANDEZ, B
ATIYA, AF
MUTHUSAMI, J
TSAI, WK
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (03): : 493 - 497
[24] VOP: Architecture of a Processor for Vector Operations in On-line Learning of Neural Networks
Mahale, Gopinath
Nandy, Soumitra K.
Bhatia, Eshan
Narayan, Ranjani
2016 29TH INTERNATIONAL CONFERENCE ON VLSI DESIGN AND 2016 15TH INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS (VLSID), 2016, : 391 - 396
[25] An on-line learning algorithm for recurrent neural networks using variational methods
Oh, WG
Suh, BS
40TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 1998, : 659 - 662
[26] Emergent on-line learning in min-max modular neural networks
Lu, BL
Ichikawa, M
IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 2650 - 2655
[27] Fault Prognosis of Mechanical Components Using On-Line Learning Neural Networks
Martinez-Rego, David
Fontenla-Romero, Oscar
Perez-Sanchez, Beatriz
Alonso-Betanzos, Amparo
ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 60 - 66
[28] Distributed On-line Learning for Random-Weight Fuzzy Neural Networks
Fierimonte, Roberto
Altilio, Rosa
Panella, Massimo
2017 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2017,
[29] Efficient on-line learning method for radial basis function neural networks
Deng, C.
Xiong, F.L.
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2001, 23 (05):
[30] Transient dynamics of on-line learning in two-layered neural networks
Biehl, M
Riegler, P
Wohler, C
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1996, 29 (16): : 4769 - 4780

← 1 2 3 4 5 →