A QUASI-NEWTON METHOD FOR LARGE SCALE SUPPORT VECTOR MACHINES

被引:0
|
作者
Mokhtari, Aryan [1 ]
Ribeiro, Alejandro [1 ]
机构
[1] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
来源
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2014年
关键词
CONVERGENCE;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper adapts a recently developed regularized stochastic version of the Broyden, Fletcher, Goldfarb, and Shanno (BFGS) quasi-Newton method for the solution of support vector machine classification problems. The proposed method is shown to converge almost surely to the optimal classifier at a rate that is linear in expectation. Numerical results show that the proposed method exhibits a convergence rate that degrades smoothly with the dimensionality of the feature vectors.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Mini-batch Quasi-Newton optimization for Large Scale Linear Support Vector Regression
    Xie, Xin
    Chen, Chao
    Chen, Zhijian
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON MECHATRONICS, MATERIALS, CHEMISTRY AND COMPUTER ENGINEERING 2015 (ICMMCCE 2015), 2015, 39 : 2613 - 2618
  • [2] A STOCHASTIC QUASI-NEWTON METHOD FOR LARGE-SCALE OPTIMIZATION
    Byrd, R. H.
    Hansen, S. L.
    Nocedal, Jorge
    Singer, Y.
    SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) : 1008 - 1031
  • [3] A LIMITED MEMORY QUASI-NEWTON METHOD FOR LARGE SCALE PROBLEM
    邓卫兵
    Numerical Mathematics A Journal of Chinese Universities(English Series), 1996, (01) : 71 - 79
  • [4] Preconditioned Subspace Quasi-Newton Method for Large Scale Optimization
    Sim, Hong Seng
    Leong, Wah June
    Abu Hassan, Malik
    Ismail, Fudziah
    PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY, 2014, 22 (01): : 175 - 192
  • [5] Preconditioning On Subspace Quasi-Newton Method For Large Scale Unconstrained Optimization
    Sim, Hong Seng
    Leong, Wah June
    Ismail, Fudziah
    STATISTICS AND OPERATIONAL RESEARCH INTERNATIONAL CONFERENCE (SORIC 2013), 2014, 1613 : 297 - 305
  • [6] A modified Quasi-Newton method for vector optimization problem
    Ansary, Md A. T.
    Panda, G.
    OPTIMIZATION, 2015, 64 (11) : 2289 - 2306
  • [7] A Sequential Subspace Quasi-Newton Method for Large-Scale Convex Optimization
    Senov, Aleksandr
    Granichin, Oleg
    Granichina, Olga
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 3627 - 3632
  • [8] A Stochastic Quasi-Newton Method for Large-Scale Nonconvex Optimization With Applications
    Chen, Huiming
    Wu, Ho-Chun
    Chan, Shing-Chow
    Lam, Wong-Hing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (11) : 4776 - 4790
  • [9] A self-scaling quasi-newton method for large scale unconstrained optimization
    Jiang, Xiaowei
    Yang, Yueting
    Journal of Information and Computational Science, 2010, 7 (08): : 1739 - 1745
  • [10] A quasi-Newton algorithm for large-scale nonlinear equations
    Huang, Linghua
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2017,