High-dimensional sign-constrained feature selection and grouping

被引:0
|
作者
Qin, Shanshan [1 ]
Ding, Hao [1 ]
Wu, Yuehua [1 ]
Liu, Feng [2 ]
机构
[1] York Univ, Dept Math & Stat, 4700 Keele St, Toronto, ON M3J 1P3, Canada
[2] Univ Technol Sydney, Australian Artificial Intelligence Inst, Sydney, NSW 2007, Australia
基金
加拿大自然科学与工程研究理事会;
关键词
Difference convex programming; Feature grouping; Feature selection; High-dimensional; Non-negative; NONNEGATIVE LEAST-SQUARES; VARIABLE SELECTION; ADAPTIVE LASSO; REGRESSION; LIKELIHOOD; RECOVERY; MODELS; PATH;
D O I
10.1007/s10463-020-00766-z
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we propose a non-negative feature selection/feature grouping (nnFSG) method for general sign-constrained high-dimensional regression problems that allows regression coefficients to be disjointly homogeneous, with sparsity as a special case. To solve the resulting non-convex optimization problem, we provide an algorithm that incorporates the difference of convex programming, augmented Lagrange and coordinate descent methods. Furthermore, we show that the aforementioned nnFSG method recovers the oracle estimate consistently, and that the mean-squared errors are bounded. Additionally, we examine the performance of our method using finite sample simulations and applying it to a real protein mass spectrum dataset.
引用
收藏
页码:787 / 819
页数:33
相关论文
共 50 条
  • [41] Extremely High-Dimensional Feature Selection via Feature Generating Samplings
    Li, Shutao
    Wei, Dan
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 737 - 747
  • [42] High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso
    Yamada, Makoto
    Jitkrittum, Wittawat
    Sigal, Leonid
    Xing, Eric P.
    Sugiyama, Masashi
    NEURAL COMPUTATION, 2014, 26 (01) : 185 - 207
  • [43] On the storage capacity with sign-constrained synaptic couplings
    Nadal, Jean-Pierre
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1990, 1 (04) : 463 - 466
  • [44] Learning Sign-Constrained Support Vector Machines
    Tajima, Kenya
    Tsuchida, Kohei
    Zara, Esmeraldo Ronnie R.
    Ohta, Naoya
    Kato, Tsuyoshi
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3264 - 3271
  • [45] A Feature Grouping Method for Ensemble Clustering of High-Dimensional Genomic Big Data
    Farid, Dewan Md.
    Nowe, Ann
    Manderick, Bernard
    PROCEEDINGS OF 2016 FUTURE TECHNOLOGIES CONFERENCE (FTC), 2016, : 260 - 268
  • [46] Weighted Outlier Detection of High-Dimensional Categorical Data Using Feature Grouping
    Li, Junli
    Zhang, Jifu
    Pang, Ning
    Qin, Xiao
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (11): : 4295 - 4308
  • [47] A Light Causal Feature Selection Approach to High-Dimensional Data
    Ling, Zhaolong
    Li, Ying
    Zhang, Yiwen
    Yu, Kui
    Zhou, Peng
    Li, Bo
    Wu, Xindong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) : 7639 - 7650
  • [48] SUBMODULAR FEATURE SELECTION FOR HIGH-DIMENSIONAL ACOUSTIC SCORE SPACES
    Liu, Yuzong
    Wei, Kai
    Kirchhoff, Katrin
    Song, Yisong
    Bilmes, Jeff
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 7184 - 7188
  • [49] Filter Feature Selection Performance Comparison in High-dimensional Data
    Huertas, Carlos
    Juarez-Ramirez, Reyes
    2014 17TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2014,
  • [50] Feature selection based on geometric distance for high-dimensional data
    Lee, J. -H.
    Oh, S. -Y.
    ELECTRONICS LETTERS, 2016, 52 (06) : 473 - 474