Recent Advances and Trends in Large-Scale Kernel Methods

被引:13
作者
Kashima, Hisashi [1 ]
Ide, Tsuyoshi [1 ]
Kato, Tsuyoshi [2 ]
Sugiyama, Masashi [3 ]
机构
[1] IBM Res Corp, Tokyo Res Lab, Yamato 2428502, Japan
[2] Ochanomizu Univ, Ctr Informat Biol, Tokyo 1128610, Japan
[3] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
关键词
kernel methods; support vector machines; kernel trick; low-rank approximation; optimilzation; structured data; DIMENSIONALITY REDUCTION; SELECTION;
D O I
10.1587/transinf.E92.D.1338
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Kernel methods such as the support vector machine are one of the most successful algorithms in modern machine learning. Their advantage is that linear algorithms are extended to non-linear scenarios in a straightforward way by the use of the kernel trick. However, naive use of kernel methods is computationally expensive since the computational complexity typically scales cubically with respect to the number of training samples. In this article. we review recent advances in the kernel methods. with emphasis on scalability for massive problems.
引用
收藏
页码:1338 / 1353
页数:16
相关论文
共 50 条
[41]   Online Budgeted Stochastic Coordinate Ascent for Large-Scale Kernelized Dual Support Vector Machine Training [J].
Qaadan, Sahar ;
Pendyala, Abhijeet ;
Schueler, Merlin ;
Glasmachers, Tobias .
PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM 2019), 2020, 11996 :23-47
[42]   A Comparison of Optimization Methods and Software for Large-scale L1-regularized Linear Classification [J].
Yuan, Guo-Xun ;
Chang, Kai-Wei ;
Hsieh, Cho-Jui ;
Lin, Chih-Jen .
JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 :3183-3234
[43]   Global and local structure preserving GPU t-SNE methods for large-scale applications [J].
Meyer, Bruno Henrique ;
Ramirez Pozo, Aurora Trinidad ;
Nunan Zola, Wagner M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 201
[44]   Novel Considerations in the ML/AI Modeling of Large-Scale Learning Loss [J].
Elizondo, Mirna ;
Yu, June ;
Payan, Daniel ;
Feng, Li ;
Tesic, Jelena .
IEEE ACCESS, 2025, 13 :7780-7792
[45]   Structural Relationships for Large-Scale Learning of Answer Re-ranking [J].
Severyn, Aliaksei ;
Moschitti, Alessandro .
SIGIR 2012: PROCEEDINGS OF THE 35TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2012, :741-750
[46]   Recent Advances on Kernel Fuzzy Support Vector Machine Model for Supervised Learning [J].
Arumugam, P. ;
Jose, P. .
2015 INTERNATIONAL CONFERENCED ON CIRCUITS, POWER AND COMPUTING TECHNOLOGIES (ICCPCT-2015), 2015,
[47]   Review of Recent Advances in Gaussian Process Regression Methods [J].
Lyu, Chenyi ;
Liu, Xingchi ;
Mihaylova, Lyudmila .
ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, UKCI 2022, 2024, 1454 :226-237
[48]   Fine-tuning the assessment of large-scale temporal trends in biodiversity using the example of British breeding birds [J].
Studeny, Angelika C. ;
Buckland, Stephen T. ;
Harrison, Philip J. ;
Illian, Janine B. ;
Magurran, Anne E. ;
Newson, Stuart E. .
JOURNAL OF APPLIED ECOLOGY, 2013, 50 (01) :190-198
[49]   Barriers to Large-scale Solar Power in Tanzania [J].
Aly, Ahmed ;
Moner-Girona, Magda ;
Szabo, Sandor ;
Pedersen, Anders Branth ;
Jensen, Steen Solvang .
ENERGY FOR SUSTAINABLE DEVELOPMENT, 2019, 48 :43-58
[50]   An efficient algorithm for large-scale causal discovery [J].
Hong, Yinghan ;
Liu, Zhusong ;
Mai, Guizhen .
SOFT COMPUTING, 2017, 21 (24) :7381-7391