Statistical Mechanical Analysis of Simultaneous Perturbation Learning

被引：1

作者：

Miyoshi, Seiji ^{[1
]}

Hikawa, Hiroomi ^{[1
]}

Maeda, Yutaka ^{[1
]}

机构：

[1] Kansai Univ, Fac Engn Sci, Dept Elect & Elect Engn, Suita, Osaka 5648680, Japan

来源：

IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES | 2009年 / E92A卷 / 07期

关键词：

simultaneous perturbation; on-line learning; statistical mechanical method; generalization error; PERCEPTRON;

D O I：

10.1587/transfun.E92.A.1743

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We show that simultaneous perturbation can be used as an algorithm for on-line learning, and we report our theoretical investigation on generalization performance obtained with a statistical mechanical method. Asymptotic behavior of generalization error using this algorithm is on the order of t to the minus one-third power, where t is the learning time or the number of teaming examples. This order is the same as that using well-known perceptron learning.

引用

页码：1743 / 1746

页数：4

共 14 条

[1] THE ADATRON - AN ADAPTIVE PERCEPTRON ALGORITHM [J].

ANLAUF, JK ;

BIEHL, M .

EUROPHYSICS LETTERS, 1989, 10 (07) :687-692

[2]

[Anonymous], 1998, On-line learning in neural networks

[3] ONLINE LEARNING WITH A PERCEPTRON [J].

BIEHL, M ;

RIEGLER, P .

EUROPHYSICS LETTERS, 1994, 28 (07) :525-530

[4]

DOMANY E, 1996, MODEL NEURAL NETWORK, V3

[5] On-line learning of unlearnable true teacher through mobile ensemble teachers [J].

Hirama, Takeshi ;

Hukushima, Koji .

JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2008, 77 (09)

[6]

MAEDA Y, 2008, SYSTEMS CONTROL INFO, V53, P47

[7] Statistical mechanics of linear and nonlinear time-domain ensemble learning [J].

Miyoshi, Seiji ;

Okada, Masato .

JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2006, 75 (12)

[8] Analysis of on-line learning when a moving teacher goes around a true teacher [J].

Miyoshi, S ;

Okada, M .

JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2006, 75 (02)

[9] Analysis of ensemble learning using simple perceptrons based on online learning theory [J].

Miyoshi, S ;

Hara, K ;

Okada, M .

PHYSICAL REVIEW E, 2005, 71 (03)

[10]

Miyoshi S., 2007, SYSTEMS CONTROL INFO, V51, P216

← 1 2 →