Model selection for partial least squares based dimension reduction

被引:8
|
作者
Li, Guo-Zheng [1 ]
Zhao, Rui-Wei [1 ]
Qu, Hai-Ni [1 ]
You, Mingyu [1 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, MOE Key Lab Embedded Syst & Serv Comp, Shanghai 201804, Peoples R China
关键词
Partial least squares; Dimension reduction; Model selection; CLASSIFICATION; REGRESSION; TUMOR; PLS;
D O I
10.1016/j.patrec.2011.11.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial least squares (PLS) has been widely applied to process scientific data sets as an effective dimension reduction technique. The main way to determine the number of dimensions extracted by PLS is by using the cross validation method, but its computation load is heavy. Researchers presented fixing the number at three, but intuitively it's not suitable for all data sets. Based on the intrinsic connection between PLS and the structure of data sets, two novel algorithms are proposed to determine the number of extracted principal components, keeping the valuable information while excluding the trivial. With the merits of variety with different data sets and easy implementation, both algorithms exhibit better performance than the previous works on nine real world data sets. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:524 / 529
页数:6
相关论文
共 50 条
  • [41] Modeling and partial least squares approaches in OODA
    Isabel Sanchez-Rodriguez, Maria
    Caridad, Jose M.
    BIOMETRICAL JOURNAL, 2014, 56 (05) : 771 - 773
  • [42] Partial least squares for discrimination
    Barker, M
    Rayens, W
    JOURNAL OF CHEMOMETRICS, 2003, 17 (03) : 166 - 173
  • [43] Improving kriging surrogates of high-dimensional design models by Partial Least Squares dimension reduction
    Mohamed Amine Bouhlel
    Nathalie Bartoli
    Abdelkader Otsmane
    Joseph Morlier
    Structural and Multidisciplinary Optimization, 2016, 53 : 935 - 952
  • [44] Improving kriging surrogates of high-dimensional design models by Partial Least Squares dimension reduction
    Bouhlel, Mohamed Amine
    Bartoli, Nathalie
    Otsmane, Abdelkader
    Morlier, Joseph
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2016, 53 (05) : 935 - 952
  • [45] A new strategy to prevent over-fitting in partial least squares models based on model population analysis
    Deng, Bai-Chuan
    Yun, Yong-Huan
    Liang, Yi-Zeng
    Cao, Dong-Sheng
    Xu, Qing-Song
    Yi, Lun-Zhao
    Huang, Xin
    ANALYTICA CHIMICA ACTA, 2015, 880 : 32 - 41
  • [46] Subspace partial least squares model for multivariate spectroscopic calibration
    Ge, Zhiqiang
    Song, Zhihuan
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2013, 125 : 51 - 57
  • [47] Probabilistic partial least squares model: Identifiability, estimation and application
    el Bouhaddani, Said
    Uh, Hae-Won
    Hayward, Caroline
    Jongbloed, Geurt
    Houwing-Duistermaat, Jeanine
    JOURNAL OF MULTIVARIATE ANALYSIS, 2018, 167 : 331 - 346
  • [48] The model space in partial least squares regression
    Pell, Randy J.
    Ramos, L. Scott
    Manne, Rolf
    JOURNAL OF CHEMOMETRICS, 2007, 21 (3-4) : 165 - 172
  • [49] Prediction of the surface tension of binary systems based on the partial least squares method
    Kim, Sung Young
    Kim, Sung Soo
    Lee, Bomsock
    KOREAN JOURNAL OF CHEMICAL ENGINEERING, 2009, 26 (02) : 349 - 353
  • [50] Model and estimators for partial least squares regression
    Helland, Inge Svein
    Saebo, Solve
    Almoy, Trygve
    Rimal, Raju
    JOURNAL OF CHEMOMETRICS, 2018, 32 (09)