An enhanced random forest with canonical partial least squares for classification

被引:5
作者
Li, Chuan-Quan [1 ]
Lin, You-Wu [2 ]
Xu, Qing-Song [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha 410083, Hunan, Peoples R China
[2] Guangxi Teachers Educ Univ, Sch Math & Stat, Nanning, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Canonical partial least squares; random forest; classification; feature rotation; CLASSIFIERS; REGRESSION; ENSEMBLE;
D O I
10.1080/03610926.2020.1716249
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Recently, several variants of random forest have been derived for the classification problems, among which the rotation forest is an important type to improve the model's accuracy. In this article, we proposed a simple and effective variation of rotation forest, which the canonical partial least squares algorithm is employed to rotate the variable space of tree and then all the trees are combined being a "forest." Results of an experiment on a sample of 20 benchmark datasets show our method has better prediction performance comparing with random forest and rotation forest.
引用
收藏
页码:4324 / 4334
页数:11
相关论文
共 50 条
  • [41] Partial least squares with a regularized weight
    Fu, Yingxiong
    Peng, Jiangtao
    Dong, Xuemei
    JOURNAL OF MATHEMATICAL CHEMISTRY, 2016, 54 (02) : 403 - 415
  • [42] Penalized partial least squares for pleiotropy
    Broc, Camilo
    Truong, Therese
    Liquet, Benoit
    BMC BIOINFORMATICS, 2021, 22 (01)
  • [43] Contribution of microarray data to the advancement of knowledge on the Mycobacterium tuberculosis interactome: Use of the random partial least squares approach
    Mazandu, Gaston K.
    Opap, Kenneth
    Mulder, Nicola J.
    INFECTION GENETICS AND EVOLUTION, 2011, 11 (04) : 725 - 733
  • [44] Sequentially orthogonalized canonical partial least squares for improved multiple responses modeling in multiblock data sets
    Mishra, Puneet
    ANALYTICA CHIMICA ACTA, 2023, 1250
  • [45] Nearest clusters based partial least squares discriminant analysis for the classification of spectral data
    Song, Weiran
    Wang, Hui
    Maguire, Paul
    Nibouche, Omar
    ANALYTICA CHIMICA ACTA, 2018, 1009 : 27 - 38
  • [46] COPULA-BASED FUNCTIONAL BAYES CLASSIFICATION WITH PRINCIPAL COMPONENTS AND PARTIAL LEAST SQUARES
    Huang, Wentian
    Ruppert, David
    STATISTICA SINICA, 2023, 33 (01) : 55 - 84
  • [47] Naive Bayes combined with partial least squares for classification of high dimensional microarray data
    Mehmood, Tahir
    Kanwal, Arzoo
    Butt, Muhammad Moeen
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2022, 222
  • [48] A Partial Least Squares Algorithm for Microarray Data Analysis Using the VIP Statistic for Gene Selection and Binary Classification
    Burguillo, Francisco J.
    Corchete, Luis A.
    Martin, Javier
    Barrera, Inmaculada
    Bardsley, William G.
    CURRENT BIOINFORMATICS, 2014, 9 (03) : 348 - 359
  • [49] Collaborative representation based classifier with partial least squares regression for the classification of spectral data
    Song, Weiran
    Wang, Hui
    Maguire, Paul
    Nibouche, Omar
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2018, 182 : 79 - 86
  • [50] Model selection for partial least squares based dimension reduction
    Li, Guo-Zheng
    Zhao, Rui-Wei
    Qu, Hai-Ni
    You, Mingyu
    PATTERN RECOGNITION LETTERS, 2012, 33 (05) : 524 - 529