Optimal Rates for Regularization of Statistical Inverse Learning Problems

被引:71
作者
Blanchard, Gilles [1 ]
Muecke, Nicole [1 ]
机构
[1] Univ Potsdam, Inst Math, Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
关键词
Reproducing kernel Hilbert space; Spectral regularization; Inverse problem; Statistical learning; Minimax convergence rates; APPROXIMATION; ALGORITHMS; REGRESSION; OPERATORS;
D O I
10.1007/s10208-017-9359-7
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider a statistical inverse learning (also called inverse regression) problem, where we observe the image of a function f through a linear operator A at i.i.d. random design points X-i , superposed with an additive noise. The distribution of the design points is unknown and can be very general. We analyze simultaneously the direct (estimation of Af) and the inverse (estimation of f) learning problems. In this general framework, we obtain strong and weak minimax optimal rates of convergence (as the number of observations n grows large) for a large class of spectral regularization methods over regularity classes defined through appropriate source conditions. This improves on or completes previous results obtained in related settings. The optimality of the obtained rates is shown not only in the exponent in n but also in the explicit dependency of the constant factor in the variance of the noise and the radius of the source condition set.
引用
收藏
页码:971 / 1013
页数:43
相关论文
共 38 条
  • [1] [Anonymous], 2008, INTRO NONPARAMETRIC
  • [2] On regularization algorithms in learning theory
    Bauer, Frank
    Pereverzev, Sergei
    Rosasco, Lorenzo
    [J]. JOURNAL OF COMPLEXITY, 2007, 23 (01) : 52 - 72
  • [3] Bhatia R, 2000, INDIANA U MATH J, V49, P1155
  • [4] BHATIA R., 1997, Matrix Analysis
  • [5] BINGHAM N. H., 1989, Encyclopedia of Math- ematics and Its Applications, V27
  • [6] Convergence rates of general regularization methods for statistical inverse problems and applications
    Bissantz, N.
    Hohage, T.
    Munk, A.
    Ruymgaart, F.
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 2007, 45 (06) : 2610 - 2636
  • [7] Blanchard G., 2016, ANAL APPL
  • [8] Blanchard G, 2006, ANN STAT, V34, P2664, DOI 10.1214/009053606000001037
  • [9] Boosting with the L2 loss:: Regression and classification
    Bühlmann, P
    Yu, B
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2003, 98 (462) : 324 - 339
  • [10] CROSS-VALIDATION BASED ADAPTATION FOR REGULARIZATION OPERATORS IN LEARNING THEORY
    Caponnetto, Andrea
    Yao, Yuan
    [J]. ANALYSIS AND APPLICATIONS, 2010, 8 (02) : 161 - 183