Convergence rates of support vector machines regression for functional data

被引:3
作者
Tong, Hongzhi [1 ]
机构
[1] Univ Int Business & Econ, Sch Stat, Beijing 100029, Peoples R China
关键词
Support vector machines regression; Reproducing kernel Hilbert space; Concentration inequality; Convergence rates; LINEAR-REGRESSION; PREDICTION; RESPONSES; MINIMAX; MODELS;
D O I
10.1016/j.jco.2021.101604
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Support vector machines regression (SVMR) is an important part of statistical learning theory. The main difference between SVMR and the classical least squares regression (LSR) is that SVMR uses the epsilon-insensitive loss rather than quadratic loss to measure the empirical error. In this paper, we consider SVMR method in the field of functional data analysis under the framework of reproducing kernel Hilbert spaces. The main tool used in our theoretical analysis is the concentration inequalities for suprema of some appropriate empirical processes. As a result, we establish explicit convergence rates of the prediction risk for SVMR, which coincide with the minimax lower bound obtained recently in literature for LSR. (C) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:14
相关论文
共 32 条
[1]   A tail inequality for suprema of unbounded empirical processes with applications to Markov chains [J].
Adamczak, Radoslaw .
ELECTRONIC JOURNAL OF PROBABILITY, 2008, 13 :1000-1034
[2]  
[Anonymous], 1998, N Y
[3]  
[Anonymous], 2002, Applied Functional Data Analysis: Methods and Case Studies
[4]  
[Anonymous], 2016, ARXIV11031458
[5]   THEORY OF REPRODUCING KERNELS [J].
ARONSZAJN, N .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1950, 68 (MAY) :337-404
[6]  
Bach F., 2002, Learning with kernels: support vector machines, regularization, optimization, and beyond
[7]   l1-PENALIZED QUANTILE REGRESSION IN HIGH-DIMENSIONAL SPARSE MODELS [J].
Belloni, Alexandre ;
Chernozhukov, Victor .
ANNALS OF STATISTICS, 2011, 39 (01) :82-130
[9]   Prediction in functional linear regression [J].
Cai, T. Tony ;
Hall, Peter .
ANNALS OF STATISTICS, 2006, 34 (05) :2159-2179
[10]   Minimax and Adaptive Prediction for Functional Linear Regression [J].
Cai, T. Tony ;
Yuan, Ming .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (499) :1201-1216