Trustworthy AI in practice: an analysis of practitioners' needs and challenges

被引:1
|
作者
Baldassarre, Maria Teresa [1 ]
Gigante, Domenico [2 ]
Kalinowski, Marcos [3 ]
Ragone, Azzurra [1 ]
Tibido, Sara [4 ]
机构
[1] Univ Bari A Moro, Bari, Italy
[2] Ser&Practices Srl, Bari, Italy
[3] Pontifical Catholic Univ Rio de Janeiro PUC Rio, Rio De Janeiro, Brazil
[4] Scuola IMT Alti Studi Lucca, Bari, Italy
来源
PROCEEDINGS OF 2024 28TH INTERNATION CONFERENCE ON EVALUATION AND ASSESSMENT IN SOFTWARE ENGINEERING, EASE 2024 | 2024年
关键词
Artificial Intelligence; Software Engineering; Trustworthy AI; Mixed-method Research; Systematic Investigation; Survey; Semi-structured Interview; BIAS;
D O I
10.1145/3661167.3661214
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recently, there has been growing attention on behalf of both academic and practice communities towards the ability of Artificial Intelligence (AI) systems to operate responsibly and ethically. As a result, a plethora of frameworks and guidelines have appeared to support practitioners in implementing Trustworthy AI applications (TAI). However, little research has been done to investigate whether such frameworks are being used and how. In this work, we study the vision AI practitioners have on TAI principles, how they address them, and what they would like to have - in terms of tools, knowledge, or guidelines - when they attempt to incorporate such principles into the systems they develop. Through a survey and semi-structured interviews, we systematically investigated practitioners' challenges and needs in developing TAI systems. Based on these practical findings, we highlight recommendations to help AI practitioners develop Trustworthy AI applications.
引用
收藏
页码:293 / 302
页数:10
相关论文
共 50 条
  • [41] A Toolkit to Enable the Design of Trustworthy AI
    Schmager, Stefan
    Sousa, Sonia
    HCI INTERNATIONAL 2021 - LATE BREAKING PAPERS: MULTIMODALITY, EXTENDED REALITY, AND ARTIFICIAL INTELLIGENCE, 2021, 13095 : 536 - 555
  • [42] Discrimination, Bias, Fairness, and Trustworthy AI
    Varona, Daniel
    Suarez, Juan Luis
    APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [43] Provenance documentation to enable explainable and trustworthy AI: A literature review
    Kale, Amruta
    Nguyen, Tin
    Harris Jr, Frederick C. C.
    Li, Chenhao
    Zhang, Jiyin
    Ma, Xiaogang
    DATA INTELLIGENCE, 2023, 5 (01) : 139 - 162
  • [44] SHAPES Project Pilots' Self-assessment for Trustworthy AI
    Rajamaki, Jyri
    Lebre Rocha, Pedro Afonso
    Perenius, Mira
    Gioulekas, Fotios
    2022 12TH INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS, SERVICES AND TECHNOLOGIES (DESSERT), 2022,
  • [45] Explainable Machine Learning for Trustworthy AI
    Giannotti, Fosca
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2022, 356 : 3 - 3
  • [46] A Leap of Faith: Is There a Formula for "Trustworthy" AI?
    Braun, Matthias
    Bleher, Hannah
    Hummel, Patrik
    HASTINGS CENTER REPORT, 2021, 51 (03) : 17 - 22
  • [47] The Role of the Right to Explanation and Its Safeguards in the Realization of Trustworthy AI
    Gazi Yalcin, Orhan
    NEW TRENDS IN DISRUPTIVE TECHNOLOGIES, TECH ETHICS AND ARTIFICIAL INTELLIGENCE, DITTET 2022, 2023, 1430 : 178 - 187
  • [48] Trustworthy AI in the public sector: An empirical analysis of a Swedish labor market decision-support system
    Berman, Alexander
    Licht, Karl de Fine
    Carlsson, Vanja
    TECHNOLOGY IN SOCIETY, 2024, 76
  • [49] Advancing Trustworthy AI: A Comparative Evaluation of AI Robustness Toolboxes
    Avinash Agarwal
    Manisha J. Nene
    SN Computer Science, 6 (3)
  • [50] Clinical perspectives on AI integration: assessing readiness and training needs among healthcare practitioners
    Masawi, Tinotenda J.
    Miller, Edward
    Rees, Daniel
    Thomas, Roderick
    JOURNAL OF DECISION SYSTEMS, 2025, 34 (01)