LEAST SQUARES APPROXIMATIONS IN LINEAR STATISTICALINVERSE LEARNING PROBLEMS

被引:0
作者
Helin, Tapio [1 ]
机构
[1] LUT Univ, Sch Engn Sci, POB 20, FI-53851 Lappeenranta, Finland
关键词
inverse problems; least squares approximations; statistical learning; minimax; DISCRETIZATION LEVEL CHOICE; INVERSE PROBLEMS; TIKHONOV REGULARIZATION; CONVERGENCE ANALYSIS; SELF-REGULARIZATION; PROJECTION METHODS; RATES; ALGORITHMS; EQUATIONS;
D O I
10.1137/22M1538600
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Statistical inverse learning aims at recovering an unknown function f from randomly scattered and possibly noisy point evaluations of another function g, connected to f via an illposed mathematical model. In this paper we blend statistical inverse learning theory with the classical regularization strategy of applying finite-dimensional projections. Our key finding is that coupling the number of random point evaluations with the choice of projection dimension, one can derive probabilistic convergence rates for the reconstruction error of the maximum likelihood (ML) estimator. Convergence rates in expectation are derived with a ML estimator complemented with a norm-based cutoff operation. Moreover, we prove that the obtained rates are minimax optimal.
引用
收藏
页码:2025 / 2047
页数:23
相关论文
共 50 条
[41]   Bounded Perturbation Regularization for Linear Least Squares Estimation [J].
Ballal, Tarig ;
Suliman, Mohamed A. ;
Al-Naffouri, Tareq Y. .
IEEE ACCESS, 2017, 5 :27551-27562
[42]   Alternating Least Squares with Incremental Learning Bias [J].
Aung, Than Htike ;
Jiamthapthaksin, Rachsuda .
PROCEEDINGS OF THE 2015 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (JCSSE), 2015, :297-302
[43]   Algorithm 937: MINRES-QLP for Symmetric and Hermitian Linear Equations and Least-Squares Problems [J].
Choi, Sou-Cheng T. ;
Saunders, Michael A. .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2014, 40 (02)
[44]   A Schur complement approach to preconditioning sparse linear least-squares problems with some dense rows [J].
Scott, Jennifer ;
Tuma, Miroslav .
NUMERICAL ALGORITHMS, 2018, 79 (04) :1147-1168
[45]   Quantum gradient descent for linear systems and least squares [J].
Kerenidis, Iordanis ;
Prakash, Anupam .
PHYSICAL REVIEW A, 2020, 101 (02)
[46]   THE PRECONDITIONED GAOR METHODS FOR GENERALIZED LEAST SQUARES PROBLEMS [J].
Ke, Yifen ;
Ma, Changfeng ;
Zhang, Huai .
JOURNAL OF APPLIED ANALYSIS AND COMPUTATION, 2021, 11 (03) :1138-1160
[47]   LU Preconditioning for Overdetermined Sparse Least Squares Problems [J].
Howell, Gary W. ;
Baboulin, Marc .
PARALLEL PROCESSING AND APPLIED MATHEMATICS, PPAM 2015, PT I, 2016, 9573 :128-137
[48]   Tikhonov regularization for weighted total least squares problems [J].
Wei, Yimin ;
Zhang, Naimin ;
Ng, Michael K. ;
Xu, Wei .
APPLIED MATHEMATICS LETTERS, 2007, 20 (01) :82-87
[49]   Regularization of Large Scale Total Least Squares Problems [J].
Voss, Heinrich ;
Lampe, Joerg .
COMPUTER INFORMATION SYSTEMS - ANALYSIS AND TECHNOLOGIES, 2011, 245 :22-+
[50]   A Contribution to Condition Numbers of Quaternion Least Squares Problems [J].
Liu, Qiaohua ;
Yu, Yuejuan ;
Wei, Yimin .
INDIAN JOURNAL OF PURE & APPLIED MATHEMATICS, 2025,