Multiple strong and balanced cluster-based ensemble of deep learners

被引:12
|
作者
Jan, Zohaib [1 ]
Verma, Brijesh [1 ]
机构
[1] Cent Queensland Univ, Ctr Intelligent Syst, Brisbane, Qld 4000, Australia
基金
澳大利亚研究理事会;
关键词
Deep learning; Ensemble classifier; Neural networks; Clustering; CLASSIFIER ENSEMBLES; RANDOM FORESTS; REGRESSION;
D O I
10.1016/j.patcog.2020.107420
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Networks (CNNs), also known as deep learners have seen much success in the last few years due to the availability of large amounts of data and high-performance computational resources. A CNN can be trained effectively if large amounts of data are available as it enables a CNN to find the optimal set of features and weights that can achieve the highest generalization performance. However, due to the requirement of large data size, CNNs require a lot of resources for example running time and computational resources to achieve a reasonable performance. Additionally, unbalanced data makes it difficult to train a CNN effectively that can achieve good generalization performance. In order to alleviate these limitations, in this paper, we propose a novel ensemble of deep learners that learns by combining multiple deep learners trained on small strongly class associated input data effectively. We propose a novel methodology of generating random subspace through clustering input data and propose a measure which can classify each cluster as a strong data cluster and a balanced data cluster. A methodology is also proposed that balances all strong data clusters in the pool so that an architecturally simple CNN can be trained on all balanced data clusters simultaneously. Classification decisions on all trained CNNs are then fused through majority voting to generate class decisions of the ensemble. The performance of the proposed ensemble approach is evaluated on UCI benchmark datasets, and results are compared with existing state-of-the-art ensemble approaches. Significance testing was conducted to further validate the efficacy of the results and a significance test analysis is presented. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Cluster-based ensemble of classifiers
    Rahman, Ashfaqur
    Verma, Brijesh
    EXPERT SYSTEMS, 2013, 30 (03) : 270 - 282
  • [2] Cluster-based deep ensemble learning for emotion classification in Internet memes
    Guo, Xiaoyu
    Ma, Jing
    Zubiaga, Arkaitz
    JOURNAL OF INFORMATION SCIENCE, 2025, 51 (01) : 265 - 283
  • [3] A Cluster-Based Classifier Ensemble as an Alternative to the Nearest Neighbor Ensemble
    Jurek, Anna
    Bi, Yaxin
    Wu, Shengli
    Nugent, Chris
    2012 IEEE 24TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2012), VOL 1, 2012, : 1100 - 1105
  • [4] A Cluster-Based Semisupervised Ensemble for Multiclass Classification
    Soares, Rodrigo G. F.
    Chen, Huanhuan
    Yao, Xin
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2017, 1 (06): : 408 - 420
  • [5] Manifold cluster-based evolutionary ensemble imbalance learning
    Guo, Yinan
    Feng, Jiawei
    Jiao, Botao
    Yang, Linkai
    Lu, Hui
    Yu, Zekuan
    COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 159
  • [6] The Core Cluster-Based Subspace Weighted Clustering Ensemble
    Huang, Xuan
    Qin, Fang
    Lin, Lin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [7] Manifold cluster-based evolutionary ensemble imbalance learning
    Guo, Yinan
    Feng, Jiawei
    Jiao, Botao
    Yang, Linkai
    Lu, Hui
    Yu, Zekuan
    Computers and Industrial Engineering, 2021, 159
  • [8] An Adaptive Cluster-Based Ensemble Learner for Computational Biology
    Jain, Niti
    Maini, Ambar
    ADVANCED COMPUTATIONAL AND COMMUNICATION PARADIGMS, VOL 2, 2018, 706 : 575 - 584
  • [9] Compact Cluster-based Balanced Distribution Adaptation for Transfer Learning
    Zhang, Xu
    Zhang, Zuyu
    Bae, HaeYoung
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Visualizing Confidence in Cluster-based Ensemble Weather Forecast Analyses
    Kumpf, Alexander
    Tost, Bianca
    Baumgart, Marlene
    Riemer, Michael
    Westermann, Rudiger
    Rautenhaus, Marc
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (01) : 109 - 119