Convergence analysis of online algorithms

被引：21
|
作者：
Ying, Yiming [1 ]
机构：
[1] City Univ Hong Kong, Dept Math, Kowloon, Hong Kong, Peoples R China
来源：
ADVANCES IN COMPUTATIONAL MATHEMATICS | 2007年 / 27卷 / 03期
关键词：
online learning algorithm; reproducing kernel Hilbert space; regularized sample error; general loss function;
D O I：
10.1007/s10444-005-9002-z
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
In this paper, we are interested in the analysis of regularized online algorithms associated with reproducing kernel Hilbert spaces. General conditions on the loss function and step sizes are given to ensure convergence. Explicit learning rates are also given for particular step sizes.
引用
收藏
页码：273 / 291
页数：19
相关论文
共 50 条
  • [21] Convergence Analysis for a Class of Nonlinear Consensus Algorithms
    Ajorlou, Amir
    Momeni, Ahmadreza
    Aghdam, Amir G.
    2010 AMERICAN CONTROL CONFERENCE, 2010, : 6318 - 6323
  • [22] An analysis about the asymptotic convergence of evolutionary algorithms
    Ding, Lixin
    Yu, Zhuomin
    2006 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, PTS 1 AND 2, PROCEEDINGS, 2006, : 248 - 253
  • [23] Modeling and convergence analysis of distributed coevolutionary algorithms
    Subbu, R
    Sanderson, AC
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02): : 806 - 822
  • [24] Nonmonotone Levenberg–Marquardt Algorithms and Their Convergence Analysis
    J. Z. Zhang
    L. H. Chen
    Journal of Optimization Theory and Applications, 1997, 92 : 393 - 418
  • [25] Convergence Analysis of Iterative Interference Alignment Algorithms
    Moreira, Darlan C.
    Silva, Yuri C. B.
    Ardah, Khaled
    Freitas, Walter C., Jr.
    Cavalcanti, Francisco R. P.
    2014 INTERNATIONAL TELECOMMUNICATIONS SYMPOSIUM (ITS), 2014,
  • [26] Modeling and convergence analysis of distributed coevolutionary algorithms
    Subbu, R
    Sanderson, AC
    PROCEEDINGS OF THE 2000 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2000, : 1276 - 1283
  • [27] Convergence analysis of gradient descent stochastic algorithms
    Shapiro, A
    Wardi, Y
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1996, 91 (02) : 439 - 454
  • [28] Robust Convergence Analysis of Distributed Optimization Algorithms
    Sundararajan, Akhil
    Hu, Bin
    Lessard, Laurent
    2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 1206 - 1212
  • [29] Convergence study of principal component analysis algorithms
    Chatterjee, C
    Roychowdhury, VP
    Chong, EKP
    1997 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, 1997, : 1798 - 1803
  • [30] Analysis of convergence of ant colony optimization algorithms
    Department of Computer Science, Nanjing Normal University, Nanjing 210097, China
    Kongzhi yu Juece Control Decis, 2006, 7 (763-766+770):
12345