Contestable AI by Design: Towards a Framework

被引:25
作者
Alfrink, Kars [1 ]
Keller, Ianus [2 ]
Kortuem, Gerd [1 ]
Doorn, Neelke [3 ]
机构
[1] Delft Univ Technol, Sustainable Design Engn, Landbergstr 15, NL-2628 CE Delft, Netherlands
[2] Delft Univ Technol, Human Ctr Design, Landbergstr 15, NL-2628 CE Delft, Netherlands
[3] Delft Univ Technol, Values Technol & Innovat, Jaffalaan 5, NL-2628 BX Delft, Netherlands
关键词
Artificial intelligence; Automated decision-making; Contestability; Design; Human-computer interaction; Machine learning; Sociotechnical systems; ALGORITHM;
D O I
10.1007/s11023-022-09611-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the use of AI systems continues to increase, so do concerns over their lack of fairness, legitimacy and accountability. Such harmful automated decision-making can be guarded against by ensuring AI systems are contestable by design: responsive to human intervention throughout the system lifecycle. Contestable AI by design is a small but growing field of research. However, most available knowledge requires a significant amount of translation to be applicable in practice. A proven way of conveying intermediate-level, generative design knowledge is in the form of frameworks. In this article we use qualitative-interpretative methods and visual mapping techniques to extract from the literature sociotechnical features and practices that contribute to contestable AI, and synthesize these into a design framework.
引用
收藏
页码:613 / 639
页数:27
相关论文
共 86 条
[1]  
Almada M, 2019, PROCEEDINGS OF THE SEVENTEENTH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND LAW, ICAIL 2019, P2, DOI 10.1145/3322640.3326699
[2]   Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability [J].
Ananny, Mike ;
Crawford, Kate .
NEW MEDIA & SOCIETY, 2018, 20 (03) :973-989
[3]  
Applebee AN., 1983, LANG ARTS, V60, P168, DOI DOI 10.58680/LA198326236
[4]   The right to contest automated decisions under the General Data Protection Regulation: Beyond the so-called "right to explanation" [J].
Bayamlioglu, Emre .
REGULATION & GOVERNANCE, 2022, 16 (04) :1058-1078
[5]   Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems [J].
Ben Shneiderman .
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2020, 10 (04)
[6]  
Binns R, 2019, An overview of the Auditing Framework for Artificial Intelligence and its core components
[7]   A Leap of Faith: Is There a Formula for "Trustworthy" AI? [J].
Braun, Matthias ;
Bleher, Hannah ;
Hummel, Patrik .
HASTINGS CENTER REPORT, 2021, 51 (03) :17-22
[8]  
Braun V, 2006, Qualitative Research in Psychology, V3, P77, DOI [10.1191/1478088706qp063oa, DOI 10.1191/1478088706QP063OA, DOI 10.1080/10875549.2021.1929659]
[9]   Do algorithms rule the world? Algorithmic decision-making and data protection in the framework of the GDPR and beyond [J].
Brkan, Maja .
INTERNATIONAL JOURNAL OF LAW AND INFORMATION TECHNOLOGY, 2019, 27 (02) :91-121
[10]  
Cavalcante Siebert L., 2022, ETHICS, DOI [10.1007/s43681-022-00167-3, DOI 10.1007/S43681-022-00167-3]