Recent Advances and Trends in Large-Scale Kernel Methods

被引:13
作者
Kashima, Hisashi [1 ]
Ide, Tsuyoshi [1 ]
Kato, Tsuyoshi [2 ]
Sugiyama, Masashi [3 ]
机构
[1] IBM Res Corp, Tokyo Res Lab, Yamato 2428502, Japan
[2] Ochanomizu Univ, Ctr Informat Biol, Tokyo 1128610, Japan
[3] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
关键词
kernel methods; support vector machines; kernel trick; low-rank approximation; optimilzation; structured data; DIMENSIONALITY REDUCTION; SELECTION;
D O I
10.1587/transinf.E92.D.1338
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Kernel methods such as the support vector machine are one of the most successful algorithms in modern machine learning. Their advantage is that linear algorithms are extended to non-linear scenarios in a straightforward way by the use of the kernel trick. However, naive use of kernel methods is computationally expensive since the computational complexity typically scales cubically with respect to the number of training samples. In this article. we review recent advances in the kernel methods. with emphasis on scalability for massive problems.
引用
收藏
页码:1338 / 1353
页数:16
相关论文
共 50 条
  • [31] A large-scale web QoS prediction scheme for the Industrial Internet of Things based on a kernel machine learning algorithm
    Luo, Xiong
    Liu, Ji
    Zhang, Dandan
    Chang, Xiaohui
    [J]. COMPUTER NETWORKS, 2016, 101 : 81 - 89
  • [32] Evolutionary Large-Scale Multi-Objective Optimization: A Survey
    Tian, Ye
    Si, Langchun
    Zhang, Xingyi
    Cheng, Ran
    He, Cheng
    Tan, Kay Chen
    Jin, Yaochu
    [J]. ACM COMPUTING SURVEYS, 2021, 54 (08)
  • [33] Revisiting the Nystrom Method for Improved Large-scale Machine Learning
    Gittens, Alex
    Mahoney, Michael W.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [34] Kernel Density Estimation, Kernel Methods, and Fast Learning in Large Data Sets
    Wang, Shitong
    Wang, Jun
    Chung, Fu-lai
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (01) : 1 - 20
  • [35] Positive Controllability of Large-Scale Networks
    Lindmark, Gustav
    Altafini, Claudio
    [J]. 2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 819 - 824
  • [36] Large-Scale Robust Semisupervised Classification
    Zhang, Lingling
    Luo, Minnan
    Li, Zhihui
    Nie, Feiping
    Zhang, Huaxiang
    Liu, Jun
    Zheng, Qinghua
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (03) : 907 - 917
  • [37] Large-scale SVD and Manifold Learning
    Talwalkar, Ameet
    Kumar, Sanjiv
    Mohri, Mehryar
    Rowley, Henry
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 3129 - 3152
  • [38] Large-Scale Sparse Logistic Regression
    Liu, Jun
    Chen, Jianhui
    Ye, Jieping
    [J]. KDD-09: 15TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2009, : 547 - 555
  • [39] Large scale kernel regression via linear programming
    Mangasarian, OL
    Musicant, DR
    [J]. MACHINE LEARNING, 2002, 46 (1-3) : 255 - 269
  • [40] Large Scale Kernel Regression via Linear Programming
    O.L. Mangasarian
    David R. Musicant
    [J]. Machine Learning, 2002, 46 : 255 - 269