An optimized fuzzy deep learning model for data classification based on NSGA-II

被引:41
作者
Yazdinejad, Abbas [1 ]
Dehghantanha, Ali [1 ]
Parizi, Reza M. [2 ]
Epiphaniou, Gregory [3 ]
机构
[1] Univ Guelph, Sch Comp Sci, Cyber Sci Lab, Guelph, ON, Canada
[2] Kennesaw State Univ, Coll Comp & Software Engn, Kennesaw, GA USA
[3] Univ Warwick, Warwick Mfg Grp WMG, Coventry, England
基金
英国工程与自然科学研究理事会;
关键词
Fuzzy DL; NSGA-II; Feature selection; Optimization; Data classification; Multimodal learning; NEURAL-NETWORK; ALGORITHM;
D O I
10.1016/j.neucom.2022.12.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a powerful paradigm, deep learning (DL) models have been used in many applications for classification tasks in images, text, and audio. Through DL models, we can learn task-driven features from big data. However, DL models are fully deterministic and cannot handle uncertain and imprecise data. DL models are often sensitive to noise in data and do not operate well in areas where data are vague. Moreover, when there is a large feature set or high-dimensional data with irrelevant and redundant features, the DL models' performance decreases in classification due to training with irrelevant features. To gain reli-able results in such high-dimensional problems, DL models require a large amount of data which usually grows exponentially concerning the number of features. Data uncertainty problems and irrelevant fea-tures in DL models cause low performance in classification tasks. This paper proposes an optimized fuzzy deep learning (OFDL) model for data classification based on Non-Dominated Sorting Genetic Algorithm II (NSGA-II). OFDL utilizes optimization in the composition of DL and fuzzy learning via the NSGA-II in multi-modal learning. To achieve effective classification, OFDL first considers intelligent feature selection by finding the best trade-offs between two conflicting objective functions, minimizing the number of fea-tures, and maximizing the accuracy (maximizing weights of selected features). Next, to reach optimized backpropagation and fuzzy membership functions, OFDL utilizes Pareto optimal solutions for multi -objective optimization using NSGA-II based on their objective functions. Furthermore, the fusion layer in OFDL fused optimized views of DL and fuzzy learning that provides a high-level representation of inputs and optimum features for classification tasks where the data contain high uncertainties and noises. This functionality gives valuable attributes during classification since identifying and selecting appropriate features ensures prompt and correct class. Also, it provides deep insight into tackling the effect of ambiguous data and each feature's uncertainty in the classification tasks. The examination of OFDL reveals good performance in terms of F-measure, accuracy, recall, precision, and True Positive Rate (TPR) compared to fuzzy classifiers. Furthermore, OFDL has higher accuracy in classification tasks than earlier fuzzy DNN models. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 44 条
[41]  
Yazdinejad A, 2019, 2019 IEEE 5TH CONFERENCE ON KNOWLEDGE BASED ENGINEERING AND INNOVATION (KBEI 2019), P515, DOI 10.1109/KBEI.2019.8734914
[42]   An end-to-end deep learning model for robust smooth filtering identification [J].
Zhang, Yujin ;
Yu, Luo ;
Fang, Zhijun ;
Xiong, Neal N. ;
Zhang, Lijun ;
Tian, Haiyue .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 127 :263-275
[43]   Fuzzy deep belief networks for semi-supervised sentiment classification [J].
Zhou, Shusen ;
Chen, Qingcai ;
Wang, Xiaolong .
NEUROCOMPUTING, 2014, 131 :312-322
[44]  
Zolfaghari B, 2022, Arxiv, DOI arXiv:2207.01590