Ensemble deep learning: A review

被引:923
作者
Ganaie, M. A. [1 ]
Hu, Minghui [2 ]
Malik, A. K. [1 ]
Tanveer, M. [1 ]
Suganthan, P. N. [2 ,3 ]
机构
[1] Indian Inst Technol Indore, Dept Math, Indore 453552, India
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
[3] Qatar Univ, KINDI Ctr Comp Res, Coll Engn, Doha, Qatar
关键词
Ensemble learning; Deep learning; NEURAL-NETWORKS; FAULT-DIAGNOSIS; RANDOM SUBSPACE; CLASSIFICATION; PREDICTION; FRAMEWORK; BIAS; REGRESSION; VARIANCE; MACHINE;
D O I
10.1016/j.engappai.2022.105151
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning models combine the advantages of both the deep learning models as well as the ensemble learning such that the final model has better generalization performance. This paper reviews the state-of-art deep ensemble models and hence serves as an extensive summary for the researchers. The ensemble models are broadly categorized into bagging, boosting, stacking, negative correlation based deep ensemble models, explicit/implicit ensembles, homogeneous/heterogeneous ensemble, decision fusion strategies based deep ensemble models. Applications of deep ensemble models in different domains are also briefly discussed. Finally, we conclude this paper with some potential future research directions.
引用
收藏
页数:18
相关论文
共 218 条
[1]  
Ahn E, 2019, Arxiv, DOI [arXiv:1906.03359, DOI 10.48550/ARXIV.1906.03359]
[2]   Enhancing unsupervised neural networks based text summarization with word embedding and ensemble learning [J].
Alami, Nabil ;
Meknassi, Mohammed ;
En-nahnahi, Noureddine .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 123 :195-211
[3]   A smart healthcare monitoring system for heart disease prediction based on ensemble deep learning and feature fusion [J].
Ali, Farman ;
El-Sappagh, Shaker ;
Islam, S. M. Riazul ;
Kwak, Daehan ;
Ali, Amjad ;
Imran, Muhammad ;
Kwak, Kyung-Sup .
INFORMATION FUSION, 2020, 63 :208-222
[4]   On building ensembles of stacked denoising auto-encoding classifiers and their further improvement [J].
Alvear-Sandoval, Ricardo F. ;
Figueiras-Vidal, Anibal R. .
INFORMATION FUSION, 2018, 39 :41-52
[5]   Ensemble of CNN for multi-focus image fusion [J].
Amin-Naji, Mostafa ;
Aghagolzadeh, Ali ;
Ezoji, Mehdi .
INFORMATION FUSION, 2019, 51 :201-214
[6]  
[Anonymous], 2014, Signal Process.
[7]  
[Anonymous], 2011, P ANN C INT SPEECH C
[8]   The power of ensembles for active learning in image classification [J].
Beluch, William H. ;
Genewein, Tim ;
Nuernberger, Andreas ;
Koehler, Jan M. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9368-9377
[9]  
Beygelzimer A, 2015, ADV NEUR IN, V28
[10]   Deep ensemble learning-based approach to real-time power system state estimation [J].
Bhusal, Narayan ;
Shukla, Raj Mani ;
Gautam, Mukesh ;
Benidris, Mohammed ;
Sengupta, Shamik .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2021, 129