Transferring Black-Box Decision Making to a White-Box Model

被引:5
作者
Zlahtic, Bojan [1 ]
Zavrsnik, Jernej [2 ,3 ,4 ,5 ]
Vosner, Helena Blazun [2 ,3 ,6 ]
Kokol, Peter [1 ,2 ]
机构
[1] Univ Maribor, Fac Elect Engn & Comp Sci, Maribor 2000, Slovenia
[2] Community Healthcare Ctr Dr Adolf Drolc Maribor, Maribor 2000, Slovenia
[3] Alma Mater Europaea ECM, Maribor 2000, Slovenia
[4] Sci & Res Ctr Koper, Koper 6000, Slovenia
[5] Univ Maribor, Fac Nat Sci & Math, Maribor 2000, Slovenia
[6] Fac Hlth & Social Sci, Slovenj Gradec 2380, Slovenia
关键词
explainable artificial intelligence; XAI; machine learning; deep learning; white box; black box; MACHINE LEARNING APPLICATIONS; BIG DATA;
D O I
10.3390/electronics13101895
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the rapidly evolving realm of artificial intelligence (AI), black-box algorithms have exhibited outstanding performance. However, their opaque nature poses challenges in fields like medicine, where the clarity of the decision-making processes is crucial for ensuring trust. Addressing this need, the study aimed to augment these algorithms with explainable AI (XAI) features to enhance transparency. A novel approach was employed, contrasting the decision-making patterns of black-box and white-box models. Where discrepancies were noted, training data were refined to align a white-box model's decisions closer to its black-box counterpart. Testing this methodology on three distinct medical datasets revealed consistent correlations between the adapted white-box models and their black-box analogs. Notably, integrating this strategy with established methods like local interpretable model-agnostic explanations (LIMEs) and SHapley Additive exPlanations (SHAPs) further enhanced transparency, underscoring the potential value of decision trees as a favored white-box algorithm in medicine due to its inherent explanatory capabilities. The findings highlight a promising path for the integration of the performance of black-box algorithms with the necessity for transparency in critical decision-making domains.
引用
收藏
页数:16
相关论文
共 44 条
[1]   Explainability for artificial intelligence in healthcare: a multidisciplinary perspective [J].
Amann, Julia ;
Blasimme, Alessandro ;
Vayena, Effy ;
Frey, Dietmar ;
Madai, Vince I. .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2020, 20 (01)
[2]  
Ancona M, 2018, Arxiv, DOI arXiv:1711.06104
[3]  
[Anonymous], Java | Oracle
[4]   Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review [J].
Antoniadi, Anna Markella ;
Du, Yuhan ;
Guendouz, Yasmine ;
Wei, Lan ;
Mazo, Claudia ;
Becker, Brett A. ;
Mooney, Catherine .
APPLIED SCIENCES-BASEL, 2021, 11 (11)
[5]  
Arnold K., 2005, The Java Programming Language
[6]  
Attwal KPS, 2020, ADV APPL MATH SCI, V19, P451
[7]   Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI [J].
Barredo Arrieta, Alejandro ;
Diaz-Rodriguez, Natalia ;
Del Ser, Javier ;
Bennetot, Adrien ;
Tabik, Siham ;
Barbado, Alberto ;
Garcia, Salvador ;
Gil-Lopez, Sergio ;
Molina, Daniel ;
Benjamins, Richard ;
Chatila, Raja ;
Herrera, Francisco .
INFORMATION FUSION, 2020, 58 :82-115
[8]   Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey [J].
Bhattacharya, Sweta ;
Maddikunta, Praveen Kumar Reddy ;
Pham, Quoc-Viet ;
Gadekallu, Thippa Reddy ;
Krishnan, S. Siva Rama ;
Chowdhary, Chiranji Lal ;
Alazab, Mamoun ;
Piran, Md. Jalil .
SUSTAINABLE CITIES AND SOCIETY, 2021, 65
[9]   A survey of machine learning applications in HIV clinical research and care [J].
Bisaso, Kuteesa R. ;
Anguzu, Godwin T. ;
Karungi, Susan A. ;
Kiragga, Agnes ;
Castelnuovo, Barbara .
COMPUTERS IN BIOLOGY AND MEDICINE, 2017, 91 :366-371
[10]   A GENERAL BLACK-BOX THEORY [J].
BUNGE, M .
PHILOSOPHY OF SCIENCE, 1963, 30 (04) :346-358