Beyond bias and discrimination: redefining the Al ethics principle of fairness in healthcare machine-learning algorithms

被引:67
作者
Giovanola, Benedetta [1 ,3 ]
Tiribelli, Simona [1 ,2 ]
机构
[1] Univ Macerata, Dept Polit Sci Commun & Int Relat, I-62100 Macerata, Italy
[2] PathCheck Fdn, Inst Technol & Global Hlth, 955 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Tufts Univ, Dept Philosophy, 222 Miner Hall, Medford, MA 02155 USA
关键词
Fairness; Healthcare machine-learning algorithms; Bias; Discrimination; Ethics of algorithms; Respect; RESPECT; PREDICTION; DIAGNOSIS;
D O I
10.1007/s00146-022-01455-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing implementation of and reliance on machine-learning (ML) algorithms to perform tasks, deliver services and make decisions in health and healthcare have made the need for fairness in ML, and more specifically in healthcare ML algorithms (HMLA), a very important and urgent task. However, while the debate on fairness in the ethics of artificial intelligence (AI) and in HMLA has grown significantly over the last decade, the very concept of fairness as an ethical value has not yet been sufficiently explored. Our paper aims to fill this gap and address the AI ethics principle of fairness from a conceptual standpoint, drawing insights from accounts of fairness elaborated in moral philosophy and using them to conceptualise fairness as an ethical value and to redefine fairness in HMLA accordingly. To achieve our goal, following a first section aimed at clarifying the background, methodology and structure of the paper, in the second section, we provide an overview of the discussion of the AI ethics principle of fairness in HMLA and show that the concept of fairness underlying this debate is framed in purely distributive terms and overlaps with non-discrimination, which is defined in turn as the absence of biases. After showing that this framing is inadequate, in the third section, we pursue an ethical inquiry into the concept of fairness and argue that fairness ought to be conceived of as an ethical value. Following a clarification of the relationship between fairness and non-discrimination, we show that the two do not overlap and that fairness requires much more than just non-discrimination. Moreover, we highlight that fairness not only has a distributive but also a socio-relational dimension. Finally, we pinpoint the constitutive components of fairness. In doing so, we base our arguments on a renewed reflection on the concept of respect, which goes beyond the idea of equal respect to include respect for individual persons. In the fourth section, we analyse the implications of our conceptual redefinition of fairness as an ethical value in the discussion of fairness in HMLA. Here, we claim that fairness requires more than non-discrimination and the absence of biases as well as more than just distribution; it needs to ensure that HMLA respects persons both as persons and as particular individuals. Finally, in the fifth section, we sketch some broader implications and show how our inquiry can contribute to making HMLA and, more generally, AI promote the social good and a fairer society.
引用
收藏
页码:549 / 563
页数:15
相关论文
共 119 条
[1]   Roles for Computing in Social Change [J].
Abebe, Rediet ;
Barocas, Solon ;
Kleinberg, Jon ;
Levy, Karen ;
Raghavan, Manish ;
Robinson, David G. .
FAT* '20: PROCEEDINGS OF THE 2020 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, 2020, :252-260
[2]  
Agarwal A, 2018, 35 INT C MACHINE LEA, V80
[3]   Using artificial intelligence methods to speed up drug discovery [J].
Alvarez-Machancoses, Oscar ;
Luis Fernandez-Martinez, Juan .
EXPERT OPINION ON DRUG DISCOVERY, 2019, 14 (08) :769-777
[4]   What is the point of equality? [J].
Anderson, ES .
ETHICS, 1999, 109 (02) :287-337
[5]  
Angwin J., 2016, ProPublica
[6]  
[Anonymous], 2016, Technical Report
[7]   Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study [J].
Bach Xuan Tran ;
Giang Thu Vu ;
Giang Hai Ha ;
Quan-Hoang Vuong ;
Manh-Tung Ho ;
Thu-Trang Vuong ;
Viet-Phuong La ;
Manh-Toan Ho ;
Nghiem, Kien-Cuong P. ;
Huong Lan Thi Nguyen ;
Latkin, Carl A. ;
Tam, Wilson W. S. ;
Cheung, Ngai-Man ;
Nguyen, Hong-Kong T. ;
Ho, Cyrus S. H. ;
Ho, Roger C. M. .
JOURNAL OF CLINICAL MEDICINE, 2019, 8 (03)
[8]   Intelligible Support Vector Machines for Diagnosis of Diabetes Mellitus [J].
Barakat, Nahla H. ;
Bradley, Andrew P. ;
Barakat, Mohamed Nabil H. .
IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2010, 14 (04) :1114-1120
[9]   Big Data's Disparate Impact [J].
Barocas, Solon ;
Selbst, Andrew D. .
CALIFORNIA LAW REVIEW, 2016, 104 (03) :671-732
[10]  
Barocas Solon., 2014, Data Ethics Workshop, Conference on Knowledge Discovery and Data Mining, P1