CASTLE: Cluster-aided space transformation for local explanations

被引:27
作者
La Gatta, Valerio [1 ]
Moscato, Vincenzo [1 ]
Postiglione, Marco [1 ]
Sperli, Giancarlo [1 ]
机构
[1] Univ Naples Federico II, Dept Elect Engn & Informat Technol DIETI, Via Claudio 21, Naples, Italy
关键词
eXplainable Artificial Intelligence; Clustering; Artificial Intelligence; Machine learning; EXPLAINABLE ARTIFICIAL-INTELLIGENCE;
D O I
10.1016/j.eswa.2021.115045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With Artificial Intelligence becoming part of a rapidly increasing number of industrial applications, more and more requirements about their transparency and trustworthiness are being demanded to AI systems, especially in military, medical and financial domains, where decisions have a huge impact on lives. In this paper, we propose a novel model-agnostic Explainable AI (XAI) technique, named Cluster-aided Space Transformation for Local Explanation (CASTLE), able to provide rule-based explanations based on both the local and global model's workings, i. e. its detailed "knowledge" in the neighborhood of the target instance and its general knowledge on the training dataset, respectively. The framework has been evaluated on six datasets in terms of temporal efficiency, cluster quality and model significance. Eventually, we asked 36 users to evaluate the explainability of the framework, getting as result an increase of interpretability of 6% with respect to another state-of-the-art technique, named Anchors.
引用
收藏
页数:12
相关论文
共 41 条
[1]   Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) [J].
Adadi, Amina ;
Berrada, Mohammed .
IEEE ACCESS, 2018, 6 :52138-52160
[2]  
Bracke P., 2019, Machine learning explainability in finance: An application to default risk analysis, V816, P44
[3]  
Carbonera JL, 2019, INT J ADV COMPUT SC, V10, P1
[4]   The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems [J].
Chatila, Raja ;
Firth-Butterflied, Kay ;
Havens, John C. ;
Karachalios, Konstantinos .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2017, 24 (01) :110-110
[5]   Predictive and Explainable Machine Learning for Industrial Internet of Things Applications [J].
Christou, Ioannis T. ;
Kefalakis, Nikos ;
Zalonis, Andreas ;
Soldatos, John .
16TH ANNUAL INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS 2020), 2020, :213-218
[6]  
Cyras K, 2019, AAAI CONF ARTIF INTE, P2752
[7]  
Ester M., 1996, PROC 2 INT C KNOWLED, P226, DOI DOI 10.5555/3001460.3001507
[8]   Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search [J].
Geyik, Sahin Cem ;
Ambler, Stuart ;
Kenthapadi, Krishnaram .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2221-2231
[9]   BEEF: Balanced English Explanations of Forecasts [J].
Grover, Sachin ;
Pulice, Chiara ;
Simari, Gerardo, I ;
Subrahmanian, V. S. .
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2019, 6 (02) :350-364
[10]   Factual and Counterfactual Explanations for Black Box Decision Making [J].
Guidotti, Riccardo ;
Monreale, Anna ;
Giannotti, Fosca ;
Pedreschi, Dino ;
Ruggieri, Salvatore ;
Turini, Franco .
IEEE INTELLIGENT SYSTEMS, 2019, 34 (06) :14-22