Model selection for partial least squares based dimension reduction

被引:8
|
作者
Li, Guo-Zheng [1 ]
Zhao, Rui-Wei [1 ]
Qu, Hai-Ni [1 ]
You, Mingyu [1 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, MOE Key Lab Embedded Syst & Serv Comp, Shanghai 201804, Peoples R China
关键词
Partial least squares; Dimension reduction; Model selection; CLASSIFICATION; REGRESSION; TUMOR; PLS;
D O I
10.1016/j.patrec.2011.11.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial least squares (PLS) has been widely applied to process scientific data sets as an effective dimension reduction technique. The main way to determine the number of dimensions extracted by PLS is by using the cross validation method, but its computation load is heavy. Researchers presented fixing the number at three, but intuitively it's not suitable for all data sets. Based on the intrinsic connection between PLS and the structure of data sets, two novel algorithms are proposed to determine the number of extracted principal components, keeping the valuable information while excluding the trivial. With the merits of variety with different data sets and easy implementation, both algorithms exhibit better performance than the previous works on nine real world data sets. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:524 / 529
页数:6
相关论文
共 50 条
  • [1] Feature selection and partial least squares based dimension reduction for tumor classification
    Bu, Hua-Long
    Li, Guo-Zheng
    Zeng, Xue-Qiang
    Yang, Jack Y.
    Yang, Mary Qu
    PROCEEDINGS OF THE 7TH IEEE INTERNATIONAL SYMPOSIUM ON BIOINFORMATICS AND BIOENGINEERING, VOLS I AND II, 2007, : 967 - +
  • [2] Partial least squares based dimension reduction with gene selection for tumor classification
    Li, Guo-Zheng
    Zeng, Xue-Qiang
    Yang, Jack Y.
    Yang, Mary Qu
    PROCEEDINGS OF THE 7TH IEEE INTERNATIONAL SYMPOSIUM ON BIOINFORMATICS AND BIOENGINEERING, VOLS I AND II, 2007, : 1439 - +
  • [3] Multispectral Dimension Reduction Algorithm Based on Partial Least Squares
    Yang Qiulan
    Wan Xiaoxia
    Xiao Gensheng
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (01)
  • [4] Sparse partial least squares regression for simultaneous dimension reduction and variable selection
    Chun, Hyonho
    Keles, Suenduez
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2010, 72 : 3 - 25
  • [5] Model selection for partial least squares regression
    Li, BB
    Morris, J
    Martin, EB
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2002, 64 (01) : 79 - 89
  • [6] On partial least squares dimension reduction for microarray-based classification: a simulation study
    Nguyen, DV
    Rocke, DM
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2004, 46 (03) : 407 - 425
  • [7] On the number of partial least squares components in dimension reduction for tumor classification
    Zeng, Xue-Qiang
    Li, Guo-Zheng
    Wu, Geng-Feng
    Zou, Hua-Xing
    EMERGING TECHNOLOGIES IN KNOWLEDGE DISCOVERY AND DATA MINING, 2007, 4819 : 206 - +
  • [8] Irrelevant gene elimination for Partial Least Squares based Dimension Reduction by using feature probes
    Zeng, Xue-Qiang
    Li, Guo-Zheng
    Wu, Geng-Feng
    Yang, Jack Y.
    Yang, Mary Qu
    INTERNATIONAL JOURNAL OF DATA MINING AND BIOINFORMATICS, 2009, 3 (01) : 85 - 103
  • [9] Optimization of Parameter Selection for Partial Least Squares Model Development
    Zhao, Na
    Wu, Zhi-sheng
    Zhang, Qiao
    Shi, Xin-yuan
    Ma, Qun
    Qiao, Yan-jiang
    SCIENTIFIC REPORTS, 2015, 5
  • [10] Optimization of Parameter Selection for Partial Least Squares Model Development
    Na Zhao
    Zhi-sheng Wu
    Qiao Zhang
    Xin-yuan Shi
    Qun Ma
    Yan-jiang Qiao
    Scientific Reports, 5