Convergence analysis of online algorithms

被引:21
|
作者
Ying, Yiming [1 ]
机构
[1] City Univ Hong Kong, Dept Math, Kowloon, Hong Kong, Peoples R China
关键词
online learning algorithm; reproducing kernel Hilbert space; regularized sample error; general loss function;
D O I
10.1007/s10444-005-9002-z
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we are interested in the analysis of regularized online algorithms associated with reproducing kernel Hilbert spaces. General conditions on the loss function and step sizes are given to ensure convergence. Explicit learning rates are also given for particular step sizes.
引用
收藏
页码:273 / 291
页数:19
相关论文
共 50 条
  • [31] Convergence analysis of MISG algorithms for MIMO systems
    Han, Lili
    Ding, Feng
    2008 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-11, 2008, : 4534 - 4539
  • [32] Convergence analysis of algorithms for memristive oscillator system
    Wu, Ailong
    Fu, Chao-Jin
    ADVANCES IN DIFFERENCE EQUATIONS, 2014,
  • [33] SIGN ALGORITHMS FOR BLIND EQUALIZATION AND THEIR CONVERGENCE ANALYSIS
    WEERACKODY, V
    KASSAM, SA
    LAKER, KR
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 1991, 10 (04) : 393 - 431
  • [34] An analysis about the asymptotic convergence of evolutionary algorithms
    Ding, Lixin
    Yu, Jinghu
    COMPUTATIONAL INTELLIGENCE AND SECURITY, 2007, 4456 : 156 - +
  • [35] Convergence of algorithms used for principal component analysis
    Zhang, Junhua
    Hanfu, Chen
    Science in China, Series E: Technological Sciences, 40 (06): : 6 - 604
  • [36] Convergence of algorithms used for principal component analysis
    张俊华
    陈翰馥
    Science in China(Series E:Technological Sciences), 1997, (06) : 597 - 604
  • [37] A local convergence analysis of bilevel decomposition algorithms
    DeMiguel, V
    Murray, W
    OPTIMIZATION AND ENGINEERING, 2006, 7 (02) : 99 - 133
  • [38] Convergence Analysis for Iterative Physical Optics Algorithms
    Gershenzon, Igor
    Boag, Amir
    Brick, Yaniv
    2017 IEEE INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION & USNC/URSI NATIONAL RADIO SCIENCE MEETING, 2017, : 2039 - 2040
  • [39] A convergence analysis of generalized hill climbing algorithms
    Sullivan, KA
    Jacobson, SH
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2001, 46 (08) : 1288 - 1293
  • [40] A dynamic convergence analysis of blind equalization algorithms
    Garth, LM
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2001, 49 (04) : 624 - 634