Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks

被引:37
作者
Barraza, Joaquin Figueroa [1 ]
Droguett, Enrique Lopez [2 ,3 ]
Martins, Marcelo Ramos [1 ]
机构
[1] Univ Sao Paulo, Dept Naval Architecture & Ocean Engn, LabRisco Anal Evaluat & Risk Management Lab, BR-05508030 Sao Paulo, Brazil
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA 90095 USA
[3] Univ Calif Los Angeles, Garrick Inst Risk Sci, Los Angeles, CA 90095 USA
关键词
feature selection; deep learning; deep neural networks; prognostics and health management; interpretable AI; RIDGE REGRESSION; PREDICTION; REPRESENTATIONS; CLASSIFICATION; ENSEMBLE; MODEL;
D O I
10.3390/s21175888
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features' importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer.
引用
收藏
页数:30
相关论文
共 87 条
[1]   Transfer Learning Approach for Classification of Histopathology Whole Slide Images [J].
Ahmed, Shakil ;
Shaikh, Asadullah ;
Alshahrani, Hani ;
Alghamdi, Abdullah ;
Alrizq, Mesfer ;
Baber, Junaid ;
Bakhtyar, Maheen .
SENSORS, 2021, 21 (16)
[2]   A smart healthcare monitoring system for heart disease prediction based on ensemble deep learning and feature fusion [J].
Ali, Farman ;
El-Sappagh, Shaker ;
Islam, S. M. Riazul ;
Kwak, Daehan ;
Ali, Amjad ;
Imran, Muhammad ;
Kwak, Kyung-Sup .
INFORMATION FUSION, 2020, 63 :208-222
[3]  
Alvarez-Melis D, 2018, ADV NEUR IN, V31
[4]  
[Anonymous], 2017, ARXIV171208645
[5]   Estimating damage size and remaining useful life in degraded structures using deep learning-based multi-source data fusion [J].
Aria, Amin ;
Lopez Droguett, Enrique ;
Azarm, Shapour ;
Modarres, Mohammad .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2020, 19 (05) :1542-1559
[6]   Capsule Neural Networks for structural damage localization and quantification using transmissibility data [J].
Barraza, Joaquin Figueroa ;
Droguett, Enrique Lopez ;
Naranjo, Viviana Meruane ;
Martins, Marcelo Ramos .
APPLIED SOFT COMPUTING, 2020, 97
[7]   Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI [J].
Barredo Arrieta, Alejandro ;
Diaz-Rodriguez, Natalia ;
Del Ser, Javier ;
Bennetot, Adrien ;
Tabik, Siham ;
Barbado, Alberto ;
Garcia, Salvador ;
Gil-Lopez, Sergio ;
Molina, Daniel ;
Benjamins, Richard ;
Chatila, Raja ;
Herrera, Francisco .
INFORMATION FUSION, 2020, 58 :82-115
[8]   Learning Sparse Feature Representations Using Probabilistic Quadtrees and Deep Belief Nets [J].
Basu, Saikat ;
Karki, Manohar ;
Ganguly, Sangram ;
DiBiano, Robert ;
Mukhopadhyay, Supratik ;
Gayaka, Shreekant ;
Kannan, Rajgopal ;
Nemani, Ramakrishna .
NEURAL PROCESSING LETTERS, 2017, 45 (03) :855-867
[9]   Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network [J].
Ben Ali, Jaouher ;
Chebel-Morello, Brigitte ;
Saidi, Lotfi ;
Malinowski, Simon ;
Fnaiech, Farhat .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2015, 56-57 :150-172
[10]   Prediction of COVID-19 from Chest CT Images Using an Ensemble of Deep Learning Models [J].
Biswas, Shreya ;
Chatterjee, Somnath ;
Majee, Arindam ;
Sen, Shibaprasad ;
Schwenker, Friedhelm ;
Sarkar, Ram .
APPLIED SCIENCES-BASEL, 2021, 11 (15)