ON LEARNING RATES FOR REGULARIZED NYSTROM SUBSAMPLING IN UNSUPERVISED DOMAIN ADAPTATION

被引:0
作者
Myleiko, H. [1 ]
Solodky, S. [1 ]
机构
[1] NAS Ukraine, Inst Math, 3 Tereschenkivska Str, UA-01024 Kiev, Ukraine
来源
JOURNAL OF APPLIED AND NUMERICAL ANALYSIS | 2023年 / 1卷
关键词
unsupervised domain adaptation; Big Data; Nystrom subsampling; regularization; source condition; Radon-Nikodym derivative; computational complexity; ILL-POSED PROBLEMS;
D O I
10.30970/ana.2023.1.58
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The regularized Nystrom subsampling is a popular approach for learning problems that deals with big data. We employ such technique in the context of the unsupervised domain adaptation problems with covariate shift assumption. Within the framework of the Reproducing Kernel Hilbert Space concept, an algorithm is constructed that is a combination of the Nystrom subsampling and the two-steps iterated Tikhonov regularization. This approach allows significantly reduce the amount of computing resources involved and at the same time maintains the same learning rates as for the standard machine learning algorithms.
引用
收藏
页码:58 / 71
页数:14
相关论文
共 23 条
[1]  
[Anonymous], 2013, Inverse Ill-posed Probl. Ser
[2]  
Bakushinskii A.B., 1967, USSR Comput. Math. Math. Phys., V7, P279
[3]   On regularization algorithms in learning theory [J].
Bauer, Frank ;
Pereverzev, Sergei ;
Rosasco, Lorenzo .
JOURNAL OF COMPLEXITY, 2007, 23 (01) :52-72
[4]   The convergence rate of a regularized ranking algorithm [J].
Chen, Hong .
JOURNAL OF APPROXIMATION THEORY, 2012, 164 (12) :1513-1519
[5]  
De Vito E, 2005, J MACH LEARN RES, V6, P883
[6]   On a regularization of unsupervised domain adaptation in RKHS [J].
Gizewski, Elke R. ;
Mayer, Lukas ;
Moser, Bernhard A. ;
Nguyen, Duc Hoan ;
Pereverzyev, Sergiy, Jr. ;
Pereverzyev, Sergei V. ;
Shepeleva, Natalia ;
Zellinger, Werner .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2022, 57 :201-227
[7]  
Kanamori T, 2009, J MACH LEARN RES, V10, P1391
[8]   Nystrom type subsampling analyzed as a regularized projection [J].
Kriukova, Galyna ;
Pereverzyev, Sergiy, Jr. ;
Tkachenko, Pavlo .
INVERSE PROBLEMS, 2017, 33 (07)
[9]   On the convergence rate and some applications of regularized ranking algorithms [J].
Kriukova, Galyna ;
Pereverzyev, Sergei V. ;
Tkachenko, Pavlo .
JOURNAL OF COMPLEXITY, 2016, 33 :14-29
[10]  
Lin SB, 2017, J MACH LEARN RES, V18