Recent Advances and Trends in Large-Scale Kernel Methods

被引:13
作者
Kashima, Hisashi [1 ]
Ide, Tsuyoshi [1 ]
Kato, Tsuyoshi [2 ]
Sugiyama, Masashi [3 ]
机构
[1] IBM Res Corp, Tokyo Res Lab, Yamato 2428502, Japan
[2] Ochanomizu Univ, Ctr Informat Biol, Tokyo 1128610, Japan
[3] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
关键词
kernel methods; support vector machines; kernel trick; low-rank approximation; optimilzation; structured data; DIMENSIONALITY REDUCTION; SELECTION;
D O I
10.1587/transinf.E92.D.1338
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Kernel methods such as the support vector machine are one of the most successful algorithms in modern machine learning. Their advantage is that linear algorithms are extended to non-linear scenarios in a straightforward way by the use of the kernel trick. However, naive use of kernel methods is computationally expensive since the computational complexity typically scales cubically with respect to the number of training samples. In this article. we review recent advances in the kernel methods. with emphasis on scalability for massive problems.
引用
收藏
页码:1338 / 1353
页数:16
相关论文
共 50 条
  • [21] Recent Advances in Large Margin Learning
    Guo, Yiwen
    Zhang, Changshui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7167 - 7174
  • [22] Efficient iterative methods for hyperparameter estimation in large-scale linear inverse problems
    Hall-Hooper, Khalil A.
    Saibaba, Arvind K.
    Chung, Julianne
    Miller, Scot M.
    ADVANCES IN COMPUTATIONAL MATHEMATICS, 2024, 50 (06)
  • [23] Variable projection methods for large-scale quadratic optimization in data analysis applications
    Galligani, E
    Ruggiero, V
    Zanni, L
    EQUILIBRIUM PROBLEMS AND VARIATIONAL MODELS, 2003, 68 : 185 - 211
  • [24] Large-Scale Portfolio Optimization Using Multiobjective Evolutionary Algorithms and Preselection Methods
    Qu, B. Y.
    Zhou, Q.
    Xiao, J. M.
    Liang, J. J.
    Suganthan, P. N.
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2017, 2017
  • [25] On the Benefits of Large Learning Rates for Kernel Methods
    Beugnot, Gaspard
    Mairal, Julien
    Rudi, Alessandro
    CONFERENCE ON LEARNING THEORY, VOL 178, 2022, 178 : 254 - 282
  • [26] Global extended Krylov subspace methods for large-scale differential Sylvester matrix equations
    El. Mostafa Sadek
    Abdeslem Hafid Bentbib
    Lakhlifa Sadek
    Hamad Talibi Alaoui
    Journal of Applied Mathematics and Computing, 2020, 62 : 157 - 177
  • [27] Global extended Krylov subspace methods for large-scale differential Sylvester matrix equations
    Sadek, El. Mostafa
    Bentbib, Abdeslem Hafid
    Sadek, Lakhlifa
    Alaoui, Hamad Talibi
    JOURNAL OF APPLIED MATHEMATICS AND COMPUTING, 2020, 62 (1-2) : 157 - 177
  • [28] Fault diagnosis of nonlinear and large-scale processes using novel modified kernel Fisher discriminant analysis approach
    Shi, Huaitao
    Liu, Jianchang
    Wu, Yuhou
    Zhang, Ke
    Zhang, Lixiu
    Xue, Peng
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2016, 47 (05) : 1095 - 1109
  • [29] Large-Scale Kernel-Based Feature Extraction via Low-Rank Subspace Tracking on a Budget
    Sheikholeslami, Fatemeh
    Berberidis, Dimitris
    Giannakis, Georgios B.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (08) : 1967 - 1981
  • [30] A large-scale web QoS prediction scheme for the Industrial Internet of Things based on a kernel machine learning algorithm
    Luo, Xiong
    Liu, Ji
    Zhang, Dandan
    Chang, Xiaohui
    COMPUTER NETWORKS, 2016, 101 : 81 - 89