The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice

被引:59
作者
Delgado, Fernando [1 ]
Yang, Stephen [1 ,2 ]
Madaio, Michael [3 ,4 ]
Yang, Qian [1 ]
机构
[1] Cornell Univ, Ithaca, NY 14850 USA
[2] Univ Southern Calif, Los Angeles, CA 90007 USA
[3] Google Res, New York, NY USA
[4] Microsoft Res, Redmond, WA USA
来源
PROCEEDINGS OF 2023 ACM CONFERENCE ON EQUITY AND ACCESS IN ALGORITHMS, MECHANISMS, AND OPTIMIZATION, EAAMO 2023 | 2023年
关键词
Artificial intelligence; machine learning; participation; participatory design; power; CO-DESIGN; HEALTH; IDEAL; CARE;
D O I
10.1145/3617694.3623261
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Despite the growing consensus that stakeholders affected by AI systems should participate in their design, enormous variation and implicit disagreements exist among current approaches. For researchers and practitioners who are interested in taking a participatory approach to AI design and development, it remains challenging to assess the extent to which any participatory approach grants substantive agency to stakeholders. This article thus aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation and through empirical investigation and critique of its current practices. Specifically, we derive a conceptual framework through synthesis of literature across technology design, political theory, and the social sciences that researchers and practitioners can leverage to evaluate approaches to participation in AI design. Additionally, we articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners. We use these empirical findings to understand the current state of participatory practice and subsequently provide guidance to better align participatory goals and methods in a way that accounts for practical constraints.
引用
收藏
页数:23
相关论文
共 50 条
[21]   Participatory design: a systematic review and insights for future practice [J].
Wacnik, Peter ;
Daly, Shanna R. ;
Verma, Aditi .
DESIGN SCIENCE, 2025, 11
[22]   Participatory design of a preliminary safety checklist for general practice [J].
Bowie, Paul ;
Ferguson, Julie ;
MacLeod, Marion ;
Kennedy, Susan ;
de Wet, Carl ;
McNab, Duncan ;
Kelly, Moya ;
McKay, John ;
Atkinson, Sarah .
BRITISH JOURNAL OF GENERAL PRACTICE, 2015, 65 (634) :E330-E343
[23]   Navigating the participatory turn in agricultural and food research: Best practice from citizen science [J].
Ajates, Raquel ;
Benyei, Petra ;
Avery, Helen ;
Butkeviciene, Egle ;
Czegledi, Alexandra ;
Desclaux, Dominique ;
Hager, Gerid ;
Heinisch, Barbara ;
Hoebe, Peter N. ;
van Noordwijk, Toos C. G. E. ;
Barzman, Marco .
AMBIO, 2025, 54 (08) :1306-1317
[24]   Federated AI, Current State, and Future Potential [J].
Clark, Phoebe ;
Oermann, Eric K. ;
Chen, Dinah ;
Al-Aswad, Lama A. .
ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY, 2023, 12 (03) :310-314
[25]   Current State of Community-Driven Radiological AI Deployment in Medical Imaging [J].
Gupta, Vikash ;
Erdal, Barbaros ;
Ramirez, Carolina ;
Floca, Ralf ;
Genereaux, Bradley ;
Bryson, Sidney ;
Bridge, Christopher ;
Kleesiek, Jens ;
Nensa, Felix ;
Braren, Rickmer ;
Younis, Khaled ;
Penzkofer, Tobias ;
Bucher, Andreas Michael ;
Qin, Ming Melvin ;
Bae, Gigon ;
Lee, Hyeonhoon ;
Cardoso, M. Jorge ;
Ourselin, Sebastien ;
Kerfoot, Eric ;
Choudhury, Rahul ;
White, Richard D. ;
Cook, Tessa ;
Bericat, David ;
Lungren, Matthew ;
Haukioja, Risto ;
Shuaib, Haris .
JMIR AI, 2024, 3
[26]   Participatory Design of an AI Digital Textbook with Deaf and Hard-of-Hearing Students [J].
Lee, Ga Young ;
Choi, Jieun ;
Na, Seonhee ;
So, Hyo-Jeong .
32ND INTERNATIONAL CONFERENCE ON COMPUTERS IN EDUCATION CONFERENCE PROCEEDINGS, ICCE 2024, VOL I, 2024, :492-497
[27]   Investigating How Generative AI Affects Decision-Making in Participatory Design [J].
Joshi, Suhas Govind ;
Tolloczko, Christopher Hagen ;
Wenaas, Snorre ;
Holm, Ola Juul ;
Langved, Martin Lorentz Fagersand .
PROCEEDINGS OF THE 13TH NORDIC CONFERENCE ON HUMAN-COMPUTER INTERACTION, NORDICHI 2024, 2024,
[28]   The Current and Future State of AI Interpretation of Medical Images [J].
Rajpurkar, Pranav ;
Lungren, Matthew P. .
NEW ENGLAND JOURNAL OF MEDICINE, 2023, 388 (21) :1981-1990
[29]   AI-CDSS Design Guidelines and Practice Verification [J].
He, Xin ;
Zheng, Xi ;
Ding, Huiyuan ;
Liu, Yixuan ;
Zhu, Hongling .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024, 40 (18) :5469-5492
[30]   Current state and promise of user-centered design to harness explainable AI in clinical decision-support systems for patients with CNS tumors [J].
Prince, Eric W. ;
Mirsky, David M. ;
Hankinson, Todd C. ;
Gorg, Carsten .
FRONTIERS IN RADIOLOGY, 2025, 4