The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice

被引:59
作者
Delgado, Fernando [1 ]
Yang, Stephen [1 ,2 ]
Madaio, Michael [3 ,4 ]
Yang, Qian [1 ]
机构
[1] Cornell Univ, Ithaca, NY 14850 USA
[2] Univ Southern Calif, Los Angeles, CA 90007 USA
[3] Google Res, New York, NY USA
[4] Microsoft Res, Redmond, WA USA
来源
PROCEEDINGS OF 2023 ACM CONFERENCE ON EQUITY AND ACCESS IN ALGORITHMS, MECHANISMS, AND OPTIMIZATION, EAAMO 2023 | 2023年
关键词
Artificial intelligence; machine learning; participation; participatory design; power; CO-DESIGN; HEALTH; IDEAL; CARE;
D O I
10.1145/3617694.3623261
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Despite the growing consensus that stakeholders affected by AI systems should participate in their design, enormous variation and implicit disagreements exist among current approaches. For researchers and practitioners who are interested in taking a participatory approach to AI design and development, it remains challenging to assess the extent to which any participatory approach grants substantive agency to stakeholders. This article thus aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation and through empirical investigation and critique of its current practices. Specifically, we derive a conceptual framework through synthesis of literature across technology design, political theory, and the social sciences that researchers and practitioners can leverage to evaluate approaches to participation in AI design. Additionally, we articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners. We use these empirical findings to understand the current state of participatory practice and subsequently provide guidance to better align participatory goals and methods in a way that accounts for practical constraints.
引用
收藏
页数:23
相关论文
共 232 条
[1]  
Abebe Rediet, 2018, AI Matters, V4, P27, DOI 10.1145/3284751.3284761
[2]   Deliberations about deliberative methods: issues in the design and evaluation of public participation processes [J].
Abelson, J ;
Forest, PG ;
Eyles, J ;
Smith, P ;
Martin, E ;
Gauvin, FP .
SOCIAL SCIENCE & MEDICINE, 2003, 57 (02) :239-251
[3]  
Ada Lovelace Institute, 2021, Participatory Data Stewardship
[4]  
Alfrink Kars, 2020, Contestable City Algorithms
[5]   Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions [J].
Alkhatib, Ali ;
Bernstein, Michael .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[6]  
Alvarado Oscar, 2020, P 11 NORD C HUM COM, P1
[7]   Guidelines for Human-AI Interaction [J].
Amershi, Saleema ;
Weld, Dan ;
Vorvoreanu, Mihaela ;
Fourney, Adam ;
Nushi, Besmira ;
Collisson, Penny ;
Suh, Jina ;
Iqbal, Shamsi ;
Bennett, Paul N. ;
Inkpen, Kori ;
Teevan, Jaime ;
Kikin-Gil, Ruth ;
Horvitz, Eric .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[8]   Street-Level Algorithms and AI in Bureaucratic Decision-Making [J].
Ammitzbøll Flügge A. ;
Hildebrandt T. ;
Møller N.H. .
Proceedings of the ACM on Human-Computer Interaction, 2021, 5 (CSCW1)
[9]   Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability [J].
Ananny, Mike ;
Crawford, Kate .
NEW MEDIA & SOCIETY, 2018, 20 (03) :973-989
[10]   Out of One, Many: Using Language Models to Simulate Human Samples [J].
Argyle, Lisa P. P. ;
Busby, Ethan C. C. ;
Fulda, Nancy ;
Gubler, Joshua R. R. ;
Rytting, Christopher ;
Wingate, David .
POLITICAL ANALYSIS, 2023, 31 (03) :337-351