Validating and Verifying AI Systems

被引:18
作者
Hand, David J. [1 ]
Khan, Shakeel [2 ]
机构
[1] Imperial Coll, Dept Math, London, England
[2] Her Majestys Revenue & Customs, Chief Data Officers Team, London, England
来源
PATTERNS | 2020年 / 1卷 / 03期
关键词
D O I
10.1016/j.patter.2020.100037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
AI systems will only fulfill their promise for society if they can be relied upon. This means that the role and task of the system must be properly formulated; that the system must be bug free, be based on properly representative data, and can cope with anomalies and data quality issues; and that its output is sufficiently accurate for the task.
引用
收藏
页数:3
相关论文
共 6 条
[1]  
Breck E., 2019, P 2 SYSML C
[2]   Assessing the Performance of Classification Methods [J].
Hand, David J. .
INTERNATIONAL STATISTICAL REVIEW, 2012, 80 (03) :400-414
[3]  
Karmon Danny, 2018, ARXIV180102608
[4]   Verification and validation and artificial intelligence [J].
Menzies, T ;
Pecheur, C .
ADVANCES IN COMPUTERS, VOL 65, 2005, 65 :153-+
[5]   Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation [J].
Wachter, Sandra ;
Mittelstadt, Brent ;
Floridi, Luciano .
INTERNATIONAL DATA PRIVACY LAW, 2017, 7 (02) :76-99
[6]   Testing and validating machine learning classifiers by metamorphic testing [J].
Xie, Xiaoyuan ;
Ho, Joshua W. K. ;
Murphy, Christian ;
Kaiser, Gail ;
Xu, Baowen ;
Chen, Tsong Yueh .
JOURNAL OF SYSTEMS AND SOFTWARE, 2011, 84 (04) :544-558