Prediction and estimation consistency of sparse multi-class penalized optimal scoring

被引:6
作者
Gaynanova, Irina [1 ]
机构
[1] Texas A&M Univ, Dept Stat, MS 3143, College Stn, TX 77843 USA
基金
美国国家科学基金会;
关键词
classification; high-dimensional regression; lasso; linear discriminant analysis; ORACLE INEQUALITIES; DISCRIMINANT-ANALYSIS; VARIABLE SELECTION; MODEL SELECTION; REGRESSION; RECOVERY;
D O I
10.3150/19-BEJ1126
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the corresponding prediction and estimation consistency results have been lacking. We bridge this gap by providing probabilistic bounds on out-of-sample prediction error and estimation error of multi-class penalized optimal scoring allowing for diverging number of classes.
引用
收藏
页码:286 / 322
页数:37
相关论文
共 44 条
[21]   Multi-class remote sensing object recognition based on discriminative sparse representation [J].
Wang, Xin ;
Shen, Siqiu ;
Ning, Chen ;
Huang, Fengchen ;
Gao, Hongmin .
APPLIED OPTICS, 2016, 55 (06) :1381-1394
[22]   A joint learning framework for optimal feature extraction and multi-class SVM ☆ [J].
Lai, Zhihui ;
Liang, Guangfei ;
Zhou, Jie ;
Kong, Heng ;
Lu, Yuwu .
INFORMATION SCIENCES, 2024, 671
[23]   Competitive Voting-based Multi-class Prediction for Ore Selection [J].
Zhang, Zelin ;
Liu, Ying ;
Hu, Qi ;
Zhang, Zhiwei ;
Liu, Yang .
2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, :514-519
[24]   Interval-based sparse ensemble multi-class classification algorithm for terahertz data [J].
Zheng, Chengyong ;
Zha, Xiaowen ;
Cai, Shengjie ;
Cui, Jing ;
Li, Qian ;
Ye, Zhijing .
HELIYON, 2024, 10 (06)
[25]   Superior scoring rules for probabilistic evaluation of single-label multi-class classification tasks [J].
Ahmadian, Rouhollah ;
Ghatee, Mehdi ;
Wahlstrom, Johan .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2025, 182
[26]   k-Version-Space Multi-class Classification Based on k-Consistency Tests [J].
Smirnov, Evgueni ;
Nalbantov, Georgi ;
Nikolaev, Nikolay .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT III, 2010, 6323 :277-292
[27]   A sparse robust model for large scale multi-class classification based on K-SVCR [J].
Ma, Jiajun ;
Zhou, Shuisheng ;
Chen, Li ;
Wan, Weiwei ;
Zhang, Zhuan .
PATTERN RECOGNITION LETTERS, 2019, 117 :16-23
[28]   Age-at-death estimation based on algorithms for multi-class discriminant analysis using binary and ordinal predictors [J].
Nikita, Efthymia ;
Nikitas, Panos .
JOURNAL OF FORENSIC AND LEGAL MEDICINE, 2025, 111
[29]   Multi-class Financial Distress Prediction Based on Feature Selection and Deep Forest Algorithm [J].
Chen, Xiaofang ;
Mao, Zengli ;
Wu, Chong .
COMPUTATIONAL ECONOMICS, 2024,
[30]   Analysis of Medical Multi-class Decision Problems with Classification and Prediction Software System (CLAPSS) [J].
Pancerz, Krzysztof .
KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KSE 2021), 2021, 192 :3979-3986