European Union Regulations on Algorithmic Decision Making and a "Right to Explanation"

被引:1062
作者
Goodman, Bryce [1 ]
Flaxman, Seth [2 ]
机构
[1] Oxford Internet Inst, Oxford, England
[2] Univ Oxford, Dept Stat, Oxford, England
基金
英国工程与自然科学研究理事会;
关键词
DISCRIMINATION;
D O I
10.1609/aimag.v38i3.2741
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We summarize the potential impact that the European Union's new General Data Protection Regulation will have on the routine use of machine-learning algorithms. Slated to take effect as law across the European Union in 2018, it will place restrictions on automated individual decision making (that is, algorithms that make decisions based on user-level predictors) that "significantly affect" users. When put into practice, the law may also effectively create a right to explanation, whereby a user can ask for an explanation of an algorithmic decision that significantly affects them. We argue that while this law may pose large challenges for industry, it highlights opportunities for computer scientists to take the lead in designing algorithms and evaluation frameworks that avoid discrimination and enable explanation.
引用
收藏
页码:50 / 57
页数:8
相关论文
共 35 条
[1]   Do Judges Vary in Their Treatment of Race? [J].
Abrams, David S. ;
Bertrand, Marianne ;
Mullainathan, Sendhil .
JOURNAL OF LEGAL STUDIES, 2012, 41 (02) :347-384
[2]   STATISTICAL-THEORIES OF DISCRIMINATION IN LABOR-MARKETS [J].
AIGNER, DJ ;
CAIN, GG .
INDUSTRIAL & LABOR RELATIONS REVIEW, 1977, 30 (02) :175-187
[3]  
Altman A., 2015, Stanford Encyclopedia of Philosophy
[4]  
[Anonymous], 2015, BLACK BOX SOC
[5]   Big Data's Disparate Impact [J].
Barocas, Solon ;
Selbst, Andrew D. .
CALIFORNIA LAW REVIEW, 2016, 104 (03) :671-732
[6]   Better decision support through exploratory discrimination-aware data mining: foundations and empirical evidence [J].
Berendt, Bettina ;
Preibusch, Soren .
ARTIFICIAL INTELLIGENCE AND LAW, 2014, 22 (02) :175-209
[7]   Exploring discrimination: A user-centric evaluation of discrimination-aware data mining [J].
Berendt, Bettina ;
Preibusch, Soeren .
12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2012), 2012, :344-351
[8]  
Bowen WilliamG., 1998, SHAPE RIVER LONG TER
[9]   Three naive Bayes approaches for discrimination-free classification [J].
Calders, Toon ;
Verwer, Sicco .
DATA MINING AND KNOWLEDGE DISCOVERY, 2010, 21 (02) :277-292
[10]   Extraneous factors in judicial decisions [J].
Danziger, Shai ;
Levav, Jonathan ;
Avnaim-Pesso, Liora .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (17) :6889-6892