Ensuring AI explainability in healthcare: problems and possible policy solutions

被引:6
|
作者
Aranovich, Tatiana de Campos [1 ]
Matulionyte, Rita [2 ]
机构
[1] Univ Fed Rio Grande do Sul, Law Sch, Porto Alegre, RS, Brazil
[2] Macquarie Univ, Law Sch, Sydney, NSW, Australia
关键词
Artificial intelligence; machine learning; transparency; explainability; medical device; regulatory approval; ARTIFICIAL-INTELLIGENCE; BLACK-BOX; EXPLANATION; DECISIONS; ALGORITHM; APPROVAL; BIAS;
D O I
10.1080/13600834.2022.2146395
中图分类号
D9 [法律]; DF [法律];
学科分类号
0301 ;
摘要
AI promises to address health services' quality and cost challenges, however, errors and bias in medical devices decisions pose threats to human health and life. This has also led to the lack of trust in AI medical devices among clinicians and patients. The goal of this article is to assess whether AI explainability principle established in numerous ethical AI frameworks can help address these and other challenges posed by AI medical devices. We first define the AI explainability principle, delineate it from the AI transparency principle, and examine which stakeholders in healthcare sector would need AI to be explainable and for what purpose. Second, we analyze whether explainable AI in healthcare is capable of achieving its intended goals. Finally, we examine robust regulatory approval framework as an alternative - and a more suitable - way in addressing challenges caused by black-box AI.
引用
收藏
页码:259 / 275
页数:17
相关论文
共 22 条
  • [1] The role of explainability and transparency in fostering trust in AI healthcare systems: a systematic literature review, open issues and potential solutions
    Christopher Ifeanyi Eke
    Liyana Shuib
    Neural Computing and Applications, 2025, 37 (4) : 1999 - 2034
  • [2] The fifty shades of black: about black box AI and explainability in healthcare
    Raposo, Vera Lucia
    MEDICAL LAW REVIEW, 2025, 33 (01)
  • [3] The ethical requirement of explainability for AI-DSS in healthcare: a systematic review of reasons
    Freyer, Nils
    Gross, Dominik
    Lipprandt, Myriam
    BMC MEDICAL ETHICS, 2024, 25 (01):
  • [4] On Explainability in AI-Solutions: A Cross-Domain Survey
    Anton, Simon D. Duque
    Schneider, Daniel
    Schotten, Hans D.
    COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2022 WORKSHOPS, 2022, 13415 : 235 - 246
  • [5] The crucial role of explainability in healthcare AI
    Beger, Jan
    EUROPEAN JOURNAL OF RADIOLOGY, 2024, 176
  • [6] Editorial: ML and AI Safety, Effectiveness and Explainability in Healthcare
    Benrimoh, David
    Israel, Sonia
    Fratila, Robert
    Armstrong, Caitrin
    Perlman, Kelly
    Rosenfeld, Ariel
    Kapelner, Adam
    FRONTIERS IN BIG DATA, 2021, 4
  • [7] Assessing the communication gap between AI models and healthcare professionals: Explainability, utility and trust in AI-driven clinical decision-making
    Wysocki, Oskar
    Davies, Jessica Katharine
    Vigo, Markel
    Armstrong, Anne Caroline
    Landers, Donal
    Lee, Rebecca
    Freitas, Andre
    ARTIFICIAL INTELLIGENCE, 2023, 316
  • [8] Healthcare AI, explainability, and the human-machine relationship: a (not so) novel practical challenge
    Giorgetti, Claudia
    Contissa, Giuseppe
    Basile, Giuseppe
    FRONTIERS IN MEDICINE, 2025, 12
  • [9] What problems is the AI act solving? Technological solutionism, fundamental rights, and trustworthiness in European AI policy
    Pham, Bao-Chau
    Davies, Sarah R.
    CRITICAL POLICY STUDIES, 2024,
  • [10] Digitalization, AI, and robotics for good care and work? German policy imaginaries of healthcare technologies
    Breuer, Svenja
    Mueller, Ruth
    SCIENCE AND PUBLIC POLICY, 2024, 51 (05) : 951 - 962