An enhanced random forest with canonical partial least squares for classification

被引:5
|
作者
Li, Chuan-Quan [1 ]
Lin, You-Wu [2 ]
Xu, Qing-Song [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha 410083, Hunan, Peoples R China
[2] Guangxi Teachers Educ Univ, Sch Math & Stat, Nanning, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Canonical partial least squares; random forest; classification; feature rotation; CLASSIFIERS; REGRESSION; ENSEMBLE;
D O I
10.1080/03610926.2020.1716249
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Recently, several variants of random forest have been derived for the classification problems, among which the rotation forest is an important type to improve the model's accuracy. In this article, we proposed a simple and effective variation of rotation forest, which the canonical partial least squares algorithm is employed to rotate the variable space of tree and then all the trees are combined being a "forest." Results of an experiment on a sample of 20 benchmark datasets show our method has better prediction performance comparing with random forest and rotation forest.
引用
收藏
页码:4324 / 4334
页数:11
相关论文
共 50 条
  • [21] The diversity in the applications of partial least squares: an overview
    Mehmood, Tahir
    Ahmed, Bilal
    JOURNAL OF CHEMOMETRICS, 2016, 30 (01) : 4 - 17
  • [22] Multiview partial least squares
    Mou, Yi
    Zhou, Long
    You, Xinge
    Lu, Yaling
    Chen, Weizhen
    Zhao, Xu
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 160 : 13 - 21
  • [23] Least squares as random walks
    Kostinski, Alexander
    Ierley, Glenn
    Kostinski, Sarah
    PHYSICS LETTERS A, 2025, 545
  • [24] Robustified least squares support vector classification
    Debruyne, Michiel
    Serneels, Sven
    Verdonck, Tim
    JOURNAL OF CHEMOMETRICS, 2009, 23 (9-10) : 479 - 486
  • [25] Comparison of partial least squares and random forests for evaluating relationship between phenolics and bioactivities of Neptunia oleracea
    Lee, Soo Yee
    Mediani, Ahmed
    Maulidiani, Maulidiani
    Khatib, Alfi
    Ismail, Intan Safinar
    Zawawi, Norhasnida
    Abas, Faridah
    JOURNAL OF THE SCIENCE OF FOOD AND AGRICULTURE, 2018, 98 (01) : 240 - 252
  • [26] Approximate Regularized Least Squares Algorithm for Classification
    Peng, Jinn
    Aved, Alex J.
    PATTERN RECOGNITION AND TRACKING XXIX, 2018, 10649
  • [27] Hyperspectral Image Classification using Random Kitchen Sink and Regularized Least Squares
    Haridas, Nikhila
    Sowmya, V
    Soman, K. P.
    2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND SIGNAL PROCESSING (ICCSP), 2015, : 1665 - 1669
  • [28] Classification of multivariate functional data on different domains with Partial Least Squares approaches
    Issam-Ali Moindjié
    Sophie Dabo-Niang
    Cristian Preda
    Statistics and Computing, 2024, 34
  • [29] A robust least squares support vector machine for regression and classification with noise
    Yang, Xiaowei
    Tan, Liangjun
    He, Lifang
    NEUROCOMPUTING, 2014, 140 : 41 - 52
  • [30] Classification and authentication of operating conditions in different processes using Partial Least Squares
    Chandra, Rubal
    Kundu, Madhusree
    CHEMICAL PRODUCT AND PROCESS MODELING, 2024, 19 (01): : 135 - 145