NONPARAMETRIC-ESTIMATION VIA EMPIRICAL RISK MINIMIZATION

被引:115
作者
LUGOSI, G [1 ]
ZEGER, K [1 ]
机构
[1] UNIV ILLINOIS,DEPT ELECT & COMP ENGN,COORDINATED SCI LAB,URBANA,IL 61801
基金
美国国家科学基金会;
关键词
REGRESSION ESTIMATION; NONPARAMETRIC ESTIMATION; CONSISTENCY; PATTERN RECOGNITION; NEURAL NETWORKS; SERIES METHODS; SIEVES;
D O I
10.1109/18.382014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A general notion of universal consistency of nonparametric estimators is introduced that applies to regression estimation, conditional median estimation, curve fitting, pattern recognition, and learning concepts. General methods for proving consistency of estimators based on minimizing the empirical error are shown, In particular, distribution-free almost sure consistency of neural network estimates and generalized linear estimators is established.
引用
收藏
页码:677 / 687
页数:11
相关论文
共 50 条
[41]   Nonparametric Estimation of Large Auctions with Risk Averse Bidders [J].
Liu, Xiaodong .
Econometric Reviews, 2016, 35 (01) :98-121
[42]   On the consistency of minimum complexity nonparametric estimation [J].
Chi, ZY ;
Geman, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (05) :1968-1973
[43]   Domain Generalization Study of Empirical Risk Minimization From Causal Perspectives [J].
Mo, Zhenling ;
Zhang, Zijun ;
Tsui, Kwok-Leung .
IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 :4284-4296
[44]   Consistency of multiclass empirical risk minimization methods based on convex loss [J].
Chen, Di-Rong ;
Sun, Tao .
JOURNAL OF MACHINE LEARNING RESEARCH, 2006, 7 :2435-2447
[45]   Super optimal rates for nonparametric density estimation via projection estimators [J].
Comte, F ;
Merlevède, F .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2005, 115 (05) :797-826
[46]   Nonlinear filtering for reflecting diffusions in random environments via nonparametric estimation [J].
Kouritzin, MA ;
Sun, W ;
Xiong, J .
ELECTRONIC JOURNAL OF PROBABILITY, 2004, 9 :560-574
[47]   A Survey of Nonparametric Mixing Density Estimation via the Predictive Recursion Algorithm [J].
Martin, Ryan .
SANKHYA-SERIES B-APPLIED AND INTERDISCIPLINARY STATISTICS, 2021, 83 (01) :97-121
[48]   Risk measures, distortion parameters, and their empirical estimation [J].
Jones, Bruce L. ;
Zitikis, Ricardas .
INSURANCE MATHEMATICS & ECONOMICS, 2007, 41 (02) :279-297
[49]   Nonparametric Estimation of the Ruin Probability in the Classical Compound Poisson Risk Model [J].
Gao, Yuan ;
Chen, Lingju ;
Jiang, Jiancheng ;
You, Honglong .
JOURNAL OF RISK AND FINANCIAL MANAGEMENT, 2020, 13 (12)
[50]   Nonparametric Estimation of Edge Values of Regression Functions [J].
Galkowski, Tomasz ;
Pawlak, Miroslaw .
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, (ICAISC 2016), PT II, 2016, 9693 :49-59