Situated algorithms: a sociotechnical systemic approach to bias

被引:29
作者
Draude, Claude [1 ]
Klumbyte, Goda [1 ]
Luecking, Phillip [1 ]
Treusch, Pat [2 ]
机构
[1] Univ Kassel, Res Ctr Informat Syst Design ITeG, Dept Gender Divers Informat Syst, Kassel, Germany
[2] Tech Univ Berlin, Ctr Interdisciplinary Womens & Gender Studies, Berlin, Germany
关键词
Gender studies; Bias; Situated knowledges; Algorithmic culture; Sociotechnical systems design; Strong objectivity; NEURAL-NETWORKS; GENDER; POLITICS;
D O I
10.1108/OIR-10-2018-0332
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Purpose The purpose of this paper is to propose that in order to tackle the question of bias in algorithms, a systemic, sociotechnical and holistic perspective is needed. With reference to the term "algorithmic culture," the interconnectedness and mutual shaping of society and technology are postulated. A sociotechnical approach requires translational work between and across disciplines. This conceptual paper undertakes such translational work. It exemplifies how gender and diversity studies, by bringing in expertise on addressing bias and structural inequalities, provide a crucial source for analyzing and mitigating bias in algorithmic systems. Design/methodology/approach After introducing the sociotechnical context, an overview is provided regarding the contemporary discourse around bias in algorithms, debates around algorithmic culture, knowledge production and bias identification as well as common solutions. The key concepts of gender studies (situated knowledges and strong objectivity) and concrete examples of gender bias then serve as a backdrop for revisiting contemporary debates. Findings The key concepts reframe the discourse on bias and concepts such as algorithmic fairness and transparency by contextualizing and situating them. The paper includes specific suggestions for researchers and practitioners on how to account for social inequalities in the design of algorithmic systems. Originality/value A systemic, gender-informed approach for addressing the issue is provided, and a concrete, applicable methodology toward a situated understanding of algorithmic bias is laid out, providing an important contribution for an urgent multidisciplinary dialogue.
引用
收藏
页码:325 / 342
页数:18
相关论文
共 85 条
[1]  
Agre P, 1997, Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide
[2]  
Akrich M., 1992, Shaping Technology-Building Society: Studies in Sociotechnical Change, P205
[3]  
Ali Syed Mustafa, 2016, XRDS, V22, P16, DOI DOI 10.1145/2930886
[4]   Towards Algorithmic Experience: Initial Efforts for Social Media Contexts [J].
Alvarado, Oscar ;
Waern, Annika .
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,
[5]   Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability [J].
Ananny, Mike ;
Crawford, Kate .
NEW MEDIA & SOCIETY, 2018, 20 (03) :973-989
[6]  
[Anonymous], UPDATING REMAIN SAME
[7]  
[Anonymous], STUDIE AUFTRAG OSTER
[8]  
[Anonymous], 1988, Probabilistic reasoning in intelligent systems, DOI DOI 10.2307/2275238
[9]  
[Anonymous], 2018, C FAIRN ACC TRANSP N
[10]  
[Anonymous], 2001, GENDER BASED ANAL GB