Model selection for partial least squares based dimension reduction

被引:8
|
作者
Li, Guo-Zheng [1 ]
Zhao, Rui-Wei [1 ]
Qu, Hai-Ni [1 ]
You, Mingyu [1 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, MOE Key Lab Embedded Syst & Serv Comp, Shanghai 201804, Peoples R China
关键词
Partial least squares; Dimension reduction; Model selection; CLASSIFICATION; REGRESSION; TUMOR; PLS;
D O I
10.1016/j.patrec.2011.11.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial least squares (PLS) has been widely applied to process scientific data sets as an effective dimension reduction technique. The main way to determine the number of dimensions extracted by PLS is by using the cross validation method, but its computation load is heavy. Researchers presented fixing the number at three, but intuitively it's not suitable for all data sets. Based on the intrinsic connection between PLS and the structure of data sets, two novel algorithms are proposed to determine the number of extracted principal components, keeping the valuable information while excluding the trivial. With the merits of variety with different data sets and easy implementation, both algorithms exhibit better performance than the previous works on nine real world data sets. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:524 / 529
页数:6
相关论文
共 50 条
  • [31] Application of Variable Selection in Hydrological Forecasting Based on Partial Least Squares
    Ma Tengfei
    Wang Chuanhai
    Ma Tengfei
    Wang Chuanhai
    PROCEEDINGS OF 2012 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2012), 2012, : 1990 - 1994
  • [32] Dimension Reduction for p53 Protein Recognition by using Incremental Partial Least Squares
    Zeng, Xue-Qiang
    Li, Guo-Zheng
    2013 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2013,
  • [33] Dimension Reduction and Regularization Combined with Partial Least Squares in High Dimensional Imaging Genetics Studies
    Le Floch, Edith
    Trinchera, Laura
    Guillemot, Vincent
    Tenenhaus, Arthur
    Poline, Jean-Baptiste
    Frouin, Vincent
    Duchesnay, Edouard
    NEW PERSPECTIVES IN PARTIAL LEAST SQUARES AND RELATED METHODS, 2013, 56 : 147 - 158
  • [34] Selection of optimal combinations of inputs in a partial least squares model for prediction of soil organic matter
    Kang, Ran
    Zhang, Xiaokang
    Liu, Huanjun
    Liu, Jiangui
    Zhang, Xinle
    Wang, Xiang
    Dou, Xin
    SPECTROSCOPY LETTERS, 2018, 51 (07) : 373 - 381
  • [35] Boosting the Performance of Genetic Algorithms for Variable Selection in Partial Least Squares Spectral Calibrations
    Lavine, Barry K.
    White, Collin G.
    APPLIED SPECTROSCOPY, 2017, 71 (09) : 2092 - 2101
  • [36] A Partial Least Squares Algorithm for Microarray Data Analysis Using the VIP Statistic for Gene Selection and Binary Classification
    Burguillo, Francisco J.
    Corchete, Luis A.
    Martin, Javier
    Barrera, Inmaculada
    Bardsley, William G.
    CURRENT BIOINFORMATICS, 2014, 9 (03) : 348 - 359
  • [37] Prediction-Oriented Model Selection in Partial Least Squares Path Modeling
    Sharma, Pratyush Nidhi
    Shmueli, Galit
    Sarstedt, Marko
    Danks, Nicholas
    Ray, Soumya
    DECISION SCIENCES, 2021, 52 (03) : 567 - 607
  • [38] Improved Parkinsonism diagnosis using a partial least squares based approach
    Segovia, F.
    Gorriz, J. M.
    Ramirez, J.
    Alvarez, I.
    Jimenez-Hoyuela, J. M.
    Ortega, S. J.
    MEDICAL PHYSICS, 2012, 39 (07) : 4395 - 4403
  • [39] Use of Partial Least Squares Regression for Variable Selection and Quality Prediction
    Jun, Chi-Hyuck
    Lee, Sang-Ho
    Park, Hae-Sang
    Lee, Jeong-Hwa
    CIE: 2009 INTERNATIONAL CONFERENCE ON COMPUTERS AND INDUSTRIAL ENGINEERING, VOLS 1-3, 2009, : 1302 - 1307
  • [40] ENVELOPE-BASED SPARSE PARTIAL LEAST SQUARES
    Zhu, Guangyu
    Su, Zhihua
    ANNALS OF STATISTICS, 2020, 48 (01) : 161 - 182