Model selection for partial least squares based dimension reduction

被引:8
|
作者
Li, Guo-Zheng [1 ]
Zhao, Rui-Wei [1 ]
Qu, Hai-Ni [1 ]
You, Mingyu [1 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, MOE Key Lab Embedded Syst & Serv Comp, Shanghai 201804, Peoples R China
关键词
Partial least squares; Dimension reduction; Model selection; CLASSIFICATION; REGRESSION; TUMOR; PLS;
D O I
10.1016/j.patrec.2011.11.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial least squares (PLS) has been widely applied to process scientific data sets as an effective dimension reduction technique. The main way to determine the number of dimensions extracted by PLS is by using the cross validation method, but its computation load is heavy. Researchers presented fixing the number at three, but intuitively it's not suitable for all data sets. Based on the intrinsic connection between PLS and the structure of data sets, two novel algorithms are proposed to determine the number of extracted principal components, keeping the valuable information while excluding the trivial. With the merits of variety with different data sets and easy implementation, both algorithms exhibit better performance than the previous works on nine real world data sets. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:524 / 529
页数:6
相关论文
共 50 条
  • [21] A partition-based variable selection in partial least squares regression
    Li, Chuan-Quan
    Fang, Zhaoyu
    Xu, Qing-Song
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2020, 198
  • [22] Relief wrapper based Kernel Partial Least Squares subspace selection
    Zhang, Buqun
    Zheng, Shangzhi
    Bu, Hualong
    Xia, Jing
    2009 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY, VOL 3, 2009, : 44 - 48
  • [23] Application of Variable Selection in Hydrological Forecasting Based on Partial Least Squares
    Ma Tengfei
    Wang Chuanhai
    Ma Tengfei
    Wang Chuanhai
    PROCEEDINGS OF 2012 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2012), 2012, : 1990 - 1994
  • [24] Feature Selection Approach based on Mutual Information and Partial Least Squares
    Shi, Qiang
    Tang, Jian
    Zhao, Lijie
    MATERIALS RESEARCH AND APPLICATIONS, PTS 1-3, 2014, 875-877 : 2025 - +
  • [25] Dimension Reduction for p53 Protein Recognition by using Incremental Partial Least Squares
    Zeng, Xue-Qiang
    Li, Guo-Zheng
    2013 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2013,
  • [26] Dimension Reduction for p53 Protein Recognition by Using Incremental Partial Least Squares
    Zeng, Xue-Qiang
    Li, Guo-Zheng
    IEEE TRANSACTIONS ON NANOBIOSCIENCE, 2014, 13 (02) : 73 - 79
  • [27] Dimension Reduction and Regularization Combined with Partial Least Squares in High Dimensional Imaging Genetics Studies
    Le Floch, Edith
    Trinchera, Laura
    Guillemot, Vincent
    Tenenhaus, Arthur
    Poline, Jean-Baptiste
    Frouin, Vincent
    Duchesnay, Edouard
    NEW PERSPECTIVES IN PARTIAL LEAST SQUARES AND RELATED METHODS, 2013, 56 : 147 - 158
  • [28] Prediction-Oriented Model Selection in Partial Least Squares Path Modeling
    Sharma, Pratyush Nidhi
    Shmueli, Galit
    Sarstedt, Marko
    Danks, Nicholas
    Ray, Soumya
    DECISION SCIENCES, 2021, 52 (03) : 567 - 607
  • [29] Two Dimension Nonnegative Partial Least Squares for Face Recognition
    Ge, Yongxin
    Bu, Wenbin
    Yang, Dan
    Feng, Xin
    Zhang, Xiaohong
    2013 9TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING (ICICS), 2013,
  • [30] Again about partial least squares and feature selection
    Zerzucha, Piotr
    Walczak, Beata
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2012, 115 : 9 - 17