The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations

被引:114
作者
Chatzimparmpas, A. [1 ]
Martins, R. M. [1 ]
Jusufi, I. [1 ]
Kucher, K. [1 ]
Rossi, F. [2 ]
Kerren, A. [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] PSL Univ, Univ Paris Dauphine, Ceremade, Paris, France
关键词
trustworthy machine learning; visualization; interpretable machine learning; explainable machine learning; HIGH-DIMENSIONAL DATA; INTERACTIVE VISUAL EXPLORATION; AQUEOUS SOLUBILITY; REGRESSION-MODELS; CLUSTER-ANALYSIS; SAMPLE-SIZE; REDUCTION; QUALITY; ANALYTICS; SYSTEM;
D O I
10.1111/cgf.14034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Machine learning (ML) models are nowadays used in complex applications in various domains, such as medicine, bioinformatics, and other sciences. Due to their black box nature, however, it may sometimes be hard to understand and trust the results they provide. This has increased the demand for reliable visualization tools related to enhancing trust in ML models, which has become a prominent topic of research in the visualization community over the past decades. To provide an overview and present the frontiers of current research on the topic, we present a State-of-the-Art Report (STAR) on enhancing trust in ML models with the use of interactive visualization. We define and describe the background of the topic, introduce a categorization for visualization techniques that aim to accomplish this goal, and discuss insights and opportunities for future research directions. Among our contributions is a categorization of trust against different facets of interactive ML, expanded and improved from previous research. Our results are investigated from different analytical perspectives: (a) providing a statistical overview, (b) summarizing key findings, (c) performing topic analyses, and (d) exploring the data sets used in the individual papers, all with the support of an interactive web-based survey browser. We intend this survey to be beneficial for visualization researchers whose interests involve making ML models more trustworthy, as well as researchers and practitioners from other disciplines in their search for effective visualization techniques suitable for solving their tasks with confidence and conveying meaning to their data.
引用
收藏
页码:713 / 756
页数:44
相关论文
共 449 条
  • [11] Alvarez-Melis David, 2018, P ICML WORKSH HUM IN
  • [12] ModelTracker: Redesigning Performance Analysis Tools for Machine Learning
    Amershi, Saleema
    Chickering, Max
    Drucker, Steven M.
    Lee, Bongshin
    Simard, Patrice
    Suh, Jina
    [J]. CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, : 337 - 346
  • [13] Power to the People: The Role of Humans in Interactive Machine Learning
    Amershi, Saleema
    Cakmak, Maya
    Knox, W. Bradley
    Kulesza, Todd
    [J]. AI MAGAZINE, 2014, 35 (04) : 105 - 120
  • [14] Amorim EPD, 2012, IEEE CONF VIS ANAL, P53, DOI 10.1109/VAST.2012.6400489
  • [15] ANDERSON EDGAR, 1936, ANN MISSOURI BOT GARD, V23, P457, DOI 10.2307/2394164
  • [16] [Anonymous], 2019, WEBP CAT
  • [17] [Anonymous], 2019, I LIDS MULT TRACK
  • [18] [Anonymous], 2019, Yelp Open Dataset
  • [19] [Anonymous], 2017, NIPS 2017 ADV ATT DE
  • [20] [Anonymous], 2019, USDA NATL NUTR DATAB