Distributed least squares prediction for functional linear regression*

被引:6
作者
Tong, Hongzhi [1 ]
机构
[1] Univ Int Business & Econ, Sch Stat, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
distributed learning; functional linear model; reproducing kernel Hilbert space; least squares regression; unlabeled data; MINIMAX; RATES;
D O I
10.1088/1361-6420/ac4153
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
To cope with the challenges of memory bottleneck and algorithmic scalability when massive data sets are involved, we propose a distributed least squares procedure in the framework of functional linear model and reproducing kernel Hilbert space. This approach divides the big data set into multiple subsets, applies regularized least squares regression on each of them, and then averages the individual outputs as a final prediction. We establish the non-asymptotic prediction error bounds for the proposed learning strategy under some regularity conditions. When the target function only has weak regularity, we also introduce some unlabelled data to construct a semi-supervised approach to enlarge the number of the partitioned subsets. Results in present paper provide a theoretical guarantee that the distributed algorithm can achieve the optimal rate of convergence while allowing the whole data set to be partitioned into a large number of subsets for parallel processing.
引用
收藏
页数:22
相关论文
共 28 条
[11]  
Guo ZC, 2017, J MACH LEARN RES, V18
[12]   Distributed learning with multi-penalty regularization [J].
Guo, Zheng-Chu ;
Lin, Shao-Bo ;
Shi, Lei .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2019, 46 (03) :478-499
[13]   Learning theory of distributed spectral algorithms [J].
Guo, Zheng-Chu ;
Lin, Shao-Bo ;
Zhou, Ding-Xuan .
INVERSE PROBLEMS, 2017, 33 (07)
[14]  
Hsing T., 2015, THEORETICAL FDN FUNC
[15]  
Lin SB, 2017, J MACH LEARN RES, V18
[16]   Distributed Kernel-Based Gradient Descent Algorithms [J].
Lin, Shao-Bo ;
Zhou, Ding-Xuan .
CONSTRUCTIVE APPROXIMATION, 2018, 47 (02) :249-276
[17]  
Mücke N, 2018, J MACH LEARN RES, V19
[18]   Distributed regression learning with coefficient regularization [J].
Pang, Mengjuan ;
Sun, Hongwei .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2018, 466 (01) :676-689
[19]  
Paulsen VI., 2016, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, DOI DOI 10.1017/CBO9781316219232
[20]  
Ramsay J., 2005, FUNCTIONAL DATA ANAL, V2 ed.