"That's important, but...": How Computer Science Researchers Anticipate Unintended Consequences of Their Research Innovations

被引:9
作者
Do, Kimberly [1 ,4 ,5 ]
Pang, Rock Yuren [2 ]
Jiang, Jiachen [3 ]
Reinecke, Katharina [2 ]
机构
[1] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
[2] Univ Washington, Paul G Allen Sch Comp Sci, Seattle, WA 98195 USA
[3] Microsoft, Redmond, WA USA
[4] Univ Washington, Seattle, WA 98195 USA
[5] Georgia Inst Technol, Atlanta, GA 30332 USA
来源
PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2023) | 2023年
基金
美国国家科学基金会;
关键词
Unintended Consequences; Computer Ethics; TECHNOLOGY; ETHICS; AI;
D O I
10.1145/3544548.3581347
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Computer science research has led to many breakthrough innovations but has also been scrutinized for enabling technology that has negative, unintended consequences for society. Given the increasing discussions of ethics in the news and among researchers, we interviewed 20 researchers in various CS sub-disciplines to identify whether and how they consider potential unintended consequences of their research innovations. We show that considering unintended consequences is generally seen as important but rarely practiced. Principal barriers are a lack of formal process and strategy as well as the academic practice that prioritizes fast progress and publications. Drawing on these findings, we discuss approaches to support researchers in routinely considering unintended consequences, from bringing diverse perspectives through community participation to increasing incentives to investigate potential consequences. We intend for our work to pave the way for routine explorations of the societal implications of technological innovations before, during, and after the research process.
引用
收藏
页数:16
相关论文
共 134 条
  • [91] Aperitif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions
    Pang, Yuren
    Reinecke, Katharina
    Just, Rene
    [J]. PROCEEDINGS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI' 22), 2022,
  • [92] Parker Donn B., 1995, ALL DAYSWORK NINE PR, P870
  • [93] Unintended by Design: On the Political Uses of "Unintended Consequences"
    Parvin, Nassim
    Pollock, Anne
    [J]. ENGAGING SCIENCE TECHNOLOGY AND SOCIETY, 2020, 6 : 320 - 327
  • [94] Pearlman Robert A., 2021, ETHICS COMMITTEES CO
  • [95] Pereida Karime, 2020, DIVERSITY ROBOTICS D
  • [96] Co-designing Resources for Ethics Education in HCI
    Pillai, Ajit G.
    Kocaballi, A. Baki
    Leong, Tuck Wah
    Calvo, Rafael A.
    Parvin, Nassim
    Shilton, Katie
    Waycott, Jenny
    Fiesler, Casey
    Havens, John C.
    Ahmadpour, Naseem
    [J]. EXTENDED ABSTRACTS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'21), 2021,
  • [97] Institutionalizing ethics in AI through broader impact requirements
    Prunkl, Carina E. A.
    Ashurst, Carolyn
    Anderljung, Markus
    Webb, Helena
    Leike, Jan
    Dafoe, Allan
    [J]. NATURE MACHINE INTELLIGENCE, 2021, 3 (02) : 104 - 110
  • [98] Rada Mihalcea, 2021, ACL ESTABLISHES ITS
  • [99] Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing
    Raji, Inioluwa Deborah
    Smart, Andrew
    White, Rebecca N.
    Mitchell, Margaret
    Gebru, Timnit
    Hutchinson, Ben
    Smith-Loud, Jamila
    Theron, Daniel
    Barnes, Parker
    [J]. FAT* '20: PROCEEDINGS OF THE 2020 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, 2020, : 33 - 44
  • [100] Real moral problems in the use of virtual reality
    Ramirez, Erick Jose
    LaBarge, Scott
    [J]. ETHICS AND INFORMATION TECHNOLOGY, 2018, 20 (04) : 249 - 263