An optimized fuzzy deep learning model for data classification based on NSGA-II

被引:41
作者
Yazdinejad, Abbas [1 ]
Dehghantanha, Ali [1 ]
Parizi, Reza M. [2 ]
Epiphaniou, Gregory [3 ]
机构
[1] Univ Guelph, Sch Comp Sci, Cyber Sci Lab, Guelph, ON, Canada
[2] Kennesaw State Univ, Coll Comp & Software Engn, Kennesaw, GA USA
[3] Univ Warwick, Warwick Mfg Grp WMG, Coventry, England
基金
英国工程与自然科学研究理事会;
关键词
Fuzzy DL; NSGA-II; Feature selection; Optimization; Data classification; Multimodal learning; NEURAL-NETWORK; ALGORITHM;
D O I
10.1016/j.neucom.2022.12.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a powerful paradigm, deep learning (DL) models have been used in many applications for classification tasks in images, text, and audio. Through DL models, we can learn task-driven features from big data. However, DL models are fully deterministic and cannot handle uncertain and imprecise data. DL models are often sensitive to noise in data and do not operate well in areas where data are vague. Moreover, when there is a large feature set or high-dimensional data with irrelevant and redundant features, the DL models' performance decreases in classification due to training with irrelevant features. To gain reli-able results in such high-dimensional problems, DL models require a large amount of data which usually grows exponentially concerning the number of features. Data uncertainty problems and irrelevant fea-tures in DL models cause low performance in classification tasks. This paper proposes an optimized fuzzy deep learning (OFDL) model for data classification based on Non-Dominated Sorting Genetic Algorithm II (NSGA-II). OFDL utilizes optimization in the composition of DL and fuzzy learning via the NSGA-II in multi-modal learning. To achieve effective classification, OFDL first considers intelligent feature selection by finding the best trade-offs between two conflicting objective functions, minimizing the number of fea-tures, and maximizing the accuracy (maximizing weights of selected features). Next, to reach optimized backpropagation and fuzzy membership functions, OFDL utilizes Pareto optimal solutions for multi -objective optimization using NSGA-II based on their objective functions. Furthermore, the fusion layer in OFDL fused optimized views of DL and fuzzy learning that provides a high-level representation of inputs and optimum features for classification tasks where the data contain high uncertainties and noises. This functionality gives valuable attributes during classification since identifying and selecting appropriate features ensures prompt and correct class. Also, it provides deep insight into tackling the effect of ambiguous data and each feature's uncertainty in the classification tasks. The examination of OFDL reveals good performance in terms of F-measure, accuracy, recall, precision, and True Positive Rate (TPR) compared to fuzzy classifiers. Furthermore, OFDL has higher accuracy in classification tasks than earlier fuzzy DNN models. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 44 条
[1]   Optimization of multiple input-output fuzzy membership functions using clonal selection algorithm [J].
Acilar, A. Merve ;
Arslan, Ahmet .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (03) :1374-1381
[2]  
[Anonymous], Scene-15 dataset
[3]   Multi-objective Genetic Algorithm Based Deep Learning Model for Automated COVID-19 Detection Using Medical Image Data [J].
Bansal, S. ;
Singh, M. ;
Dubey, R. K. ;
Panigrahi, B. K. .
JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2021, 41 (05) :678-689
[4]   Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction [J].
Casillas, J ;
Cordón, O ;
del Jesus, MJ ;
Herrera, F .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2005, 13 (01) :13-29
[5]   A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification [J].
Deng, Yue ;
Ren, Zhiquan ;
Kong, Youyong ;
Bao, Feng ;
Dai, Qionghai .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (04) :1006-1012
[6]   An Unsupervised Fuzzy Clustering Approach for Early Screening of COVID-19 From Radiological Images [J].
Ding, Weiping ;
Chakraborty, Shouvik ;
Mali, Kalyani ;
Chatterjee, Sankhadeep ;
Nayak, Janmenjoy ;
Das, Asit Kumar ;
Banerjee, Soumen .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2022, 30 (08) :2902-2914
[7]   Sequence classification of the limit order book using recurrent neural networks [J].
Dixon, Matthew .
JOURNAL OF COMPUTATIONAL SCIENCE, 2018, 24 :277-286
[8]   Application of Music Industry Based on the Deep Neural Network [J].
Fan, Minglei .
SCIENTIFIC PROGRAMMING, 2022, 2022
[9]  
Folkersma L., 2020, THESIS
[10]  
fylearn, 2020, FUZZ MACH LEARN ALG