Convergence analysis of online algorithms

被引：21
|
作者：
Ying, Yiming [1 ]
机构：
[1] City Univ Hong Kong, Dept Math, Kowloon, Hong Kong, Peoples R China
来源：
ADVANCES IN COMPUTATIONAL MATHEMATICS | 2007年 / 27卷 / 03期
关键词：
online learning algorithm; reproducing kernel Hilbert space; regularized sample error; general loss function;
D O I：
10.1007/s10444-005-9002-z
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
In this paper, we are interested in the analysis of regularized online algorithms associated with reproducing kernel Hilbert spaces. General conditions on the loss function and step sizes are given to ensure convergence. Explicit learning rates are also given for particular step sizes.
引用
收藏
页码：273 / 291
页数：19
相关论文
共 50 条
  • [41] Convergence Analysis of Iterative Algorithms for Phase Retrieval
    Luke, D. Russell
    Martins, Anna-Lena
    NANOSCALE PHOTONIC IMAGING, 2020, 134 : 583 - 601
  • [42] Convergence of algorithms used for principal component analysis
    Junhua Zhang
    Hanfu Chen
    Science in China Series E: Technological Sciences, 1997, 40 : 597 - 604
  • [43] Local convergence analysis of FastICA and related algorithms
    Shen, Hao
    Kleinsteuber, Martin
    Hueper, Knut
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (06): : 1022 - 1032
  • [44] A local convergence analysis of bilevel decomposition algorithms
    Victor DeMiguel
    Walter Murray
    Optimization and Engineering, 2006, 7 : 99 - 133
  • [45] ERROR ANALYSIS AND CONVERGENCE OF CAPACITY DIMENSION ALGORITHMS
    HUNT, F
    SIAM JOURNAL ON APPLIED MATHEMATICS, 1990, 50 (01) : 307 - 321
  • [46] Probabilistic Analysis of Online Stacking Algorithms
    Olsen, Martin
    Gross, Allan
    COMPUTATIONAL LOGISTICS (ICCL 2015), 2015, 9335 : 358 - 369
  • [47] ANALYSIS OF ONLINE ALGORITHMS FOR ORGAN ALLOCATION
    UR, S
    TRICK, M
    SLEATOR, D
    IFIP TRANSACTIONS A-COMPUTER SCIENCE AND TECHNOLOGY, 1992, 12 : 458 - 464
  • [48] Non-monotonic convergence of online learning algorithms for perceptrons with noisy teacher
    Ikeda, Kazushi
    Honda, Arata
    Hanzawa, Hiroaki
    Miyoshi, Seiji
    NEURAL NETWORKS, 2018, 102 : 21 - 26
  • [49] Convergence of the Single-Pass and Online Fuzzy C-Means Algorithms
    Hall, Lawrence O.
    Goldgof, Dmitry B.
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2011, 19 (04) : 792 - 794
  • [50] Convergence Analysis on Trace Ratio Linear Discriminant Analysis Algorithms
    Ye, Qiaolin
    Yang, Jie
    Zheng, Hao
    Fu, Liyong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (02) : 3878 - 3881
12345