A weighted voting ensemble of efficient regularized extreme learning machine

被引:14
作者
Abd Shehab, Mohanad [1 ]
Kahraman, Nihan [2 ]
机构
[1] Mustansiriyah Univ, Engn Coll, Elect Engn Dept, Baghdad, Iraq
[2] Yildiz Tech Univ, Dept Elect & Commun Engn, Istanbul, Turkey
关键词
Extreme learning machines; Ensemble; PRESS; SVD; Weighted majority voting; Face recognition; FACE RECOGNITION;
D O I
10.1016/j.compeleceng.2020.106639
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The exact evaluation of Extreme Learning Machine (ELM) compactness is difficult due to the randomness in hidden layer nodes number, weight and bias values. To overcome this randomness, and other problems such as resultant overfitting and large variance, a selective weighted voting ensemble model based on regularized ELM is investigated. It can strongly enhance the overall performance including accuracy, variance and time consumption. Efficient Prediction Sum of Squares (PRESS) criteria that utilizing Singular Value Decomposition (SVD) is proposed to address the slow execution. Furthermore, an ensemble pruning approach based on the eigenvalues for the input weight matrix is developed. In this work, the ensemble base classifiers weights are calculated based on the same PRESS error metric used for the solutions of the output weight vector (beta) in RELM, thus, it can reduce computational cost and space requirement. Different state-of-the-art learning approaches and various well-known facial expressions faces and object recognition benchmark datasets were examined in this work. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 29 条
  • [1] Alim Samat, 2014, IEEE J SELECTED TOPI, V7
  • [2] [Anonymous], 2016, UCI MACHINE LEARNING
  • [3] Cao J, 2014, SPRINGERBRIEF COMPUT, P1, DOI 10.1007/978-1-4939-0416-7
  • [4] Class-specific soft voting based multiple extreme learning machines ensemble
    Cao, Jingjing
    Kwong, Sam
    Wang, Ran
    Li, Xiaodong
    Kong, Xiangfei
    [J]. NEUROCOMPUTING, 2015, 149 : 275 - 284
  • [5] Ensemble extreme learning machine and sparse representation classification
    Cao, Jiuwen
    Hao, Jiaoping
    Lai, Xiaoping
    Vong, Chi-Man
    Luo, Minxia
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2016, 353 (17): : 4526 - 4541
  • [6] Voting based extreme learning machine
    Cao, Jiuwen
    Lin, Zhiping
    Huang, Guang-Bin
    Liu, Nan
    [J]. INFORMATION SCIENCES, 2012, 185 (01) : 66 - 77
  • [7] From few to many: Illumination cone models for face recognition under variable lighting and pose
    Georghiades, AS
    Belhumeur, PN
    Kriegman, DJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) : 643 - 660
  • [8] Comparative analysis of reference evapotranspiration equations modelling by extreme learning machine
    Gocic, Milan
    Petkovic, Dalibor
    Shamshirband, Shahaboddin
    Kamsin, Amirrudin
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 127 : 56 - 63
  • [9] Classifying Uncertain and Evolving Data Streams with Distributed Extreme Learning Machine
    Han, Dong-Hong
    Zhang, Xin
    Wang, Guo-Ren
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2015, 30 (04) : 874 - 887
  • [10] Trends in extreme learning machines: A review
    Huang, Gao
    Huang, Guang-Bin
    Song, Shiji
    You, Keyou
    [J]. NEURAL NETWORKS, 2015, 61 : 32 - 48