Ensuring AI explainability in healthcare: problems and possible policy solutions

被引:6
作者
Aranovich, Tatiana de Campos [1 ]
Matulionyte, Rita [2 ]
机构
[1] Univ Fed Rio Grande do Sul, Law Sch, Porto Alegre, RS, Brazil
[2] Macquarie Univ, Law Sch, Sydney, NSW, Australia
关键词
Artificial intelligence; machine learning; transparency; explainability; medical device; regulatory approval; ARTIFICIAL-INTELLIGENCE; BLACK-BOX; EXPLANATION; DECISIONS; ALGORITHM; APPROVAL; BIAS;
D O I
10.1080/13600834.2022.2146395
中图分类号
D9 [法律]; DF [法律];
学科分类号
0301 ;
摘要
AI promises to address health services' quality and cost challenges, however, errors and bias in medical devices decisions pose threats to human health and life. This has also led to the lack of trust in AI medical devices among clinicians and patients. The goal of this article is to assess whether AI explainability principle established in numerous ethical AI frameworks can help address these and other challenges posed by AI medical devices. We first define the AI explainability principle, delineate it from the AI transparency principle, and examine which stakeholders in healthcare sector would need AI to be explainable and for what purpose. Second, we analyze whether explainable AI in healthcare is capable of achieving its intended goals. Finally, we examine robust regulatory approval framework as an alternative - and a more suitable - way in addressing challenges caused by black-box AI.
引用
收藏
页码:259 / 275
页数:17
相关论文
共 22 条
[1]   The role of explainability and transparency in fostering trust in AI healthcare systems: a systematic literature review, open issues and potential solutions [J].
Christopher Ifeanyi Eke ;
Liyana Shuib .
Neural Computing and Applications, 2025, 37 (4) :1999-2034
[2]   The fifty shades of black: about black box AI and explainability in healthcare [J].
Raposo, Vera Lucia .
MEDICAL LAW REVIEW, 2025, 33 (01)
[3]   The ethical requirement of explainability for AI-DSS in healthcare: a systematic review of reasons [J].
Freyer, Nils ;
Gross, Dominik ;
Lipprandt, Myriam .
BMC MEDICAL ETHICS, 2024, 25 (01)
[4]   On Explainability in AI-Solutions: A Cross-Domain Survey [J].
Anton, Simon D. Duque ;
Schneider, Daniel ;
Schotten, Hans D. .
COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2022 WORKSHOPS, 2022, 13415 :235-246
[5]   The crucial role of explainability in healthcare AI [J].
Beger, Jan .
EUROPEAN JOURNAL OF RADIOLOGY, 2024, 176
[6]   Editorial: ML and AI Safety, Effectiveness and Explainability in Healthcare [J].
Benrimoh, David ;
Israel, Sonia ;
Fratila, Robert ;
Armstrong, Caitrin ;
Perlman, Kelly ;
Rosenfeld, Ariel ;
Kapelner, Adam .
FRONTIERS IN BIG DATA, 2021, 4
[7]   Assessing the communication gap between AI models and healthcare professionals: Explainability, utility and trust in AI-driven clinical decision-making [J].
Wysocki, Oskar ;
Davies, Jessica Katharine ;
Vigo, Markel ;
Armstrong, Anne Caroline ;
Landers, Donal ;
Lee, Rebecca ;
Freitas, Andre .
ARTIFICIAL INTELLIGENCE, 2023, 316
[8]   Healthcare AI, explainability, and the human-machine relationship: a (not so) novel practical challenge [J].
Giorgetti, Claudia ;
Contissa, Giuseppe ;
Basile, Giuseppe .
FRONTIERS IN MEDICINE, 2025, 12
[9]   What problems is the AI act solving? Technological solutionism, fundamental rights, and trustworthiness in European AI policy [J].
Pham, Bao-Chau ;
Davies, Sarah R. .
CRITICAL POLICY STUDIES, 2024,
[10]   Digitalization, AI, and robotics for good care and work? German policy imaginaries of healthcare technologies [J].
Breuer, Svenja ;
Mueller, Ruth .
SCIENCE AND PUBLIC POLICY, 2024, 51 (05) :951-962