The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations

被引:114
作者
Chatzimparmpas, A. [1 ]
Martins, R. M. [1 ]
Jusufi, I. [1 ]
Kucher, K. [1 ]
Rossi, F. [2 ]
Kerren, A. [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] PSL Univ, Univ Paris Dauphine, Ceremade, Paris, France
关键词
trustworthy machine learning; visualization; interpretable machine learning; explainable machine learning; HIGH-DIMENSIONAL DATA; INTERACTIVE VISUAL EXPLORATION; AQUEOUS SOLUBILITY; REGRESSION-MODELS; CLUSTER-ANALYSIS; SAMPLE-SIZE; REDUCTION; QUALITY; ANALYTICS; SYSTEM;
D O I
10.1111/cgf.14034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Machine learning (ML) models are nowadays used in complex applications in various domains, such as medicine, bioinformatics, and other sciences. Due to their black box nature, however, it may sometimes be hard to understand and trust the results they provide. This has increased the demand for reliable visualization tools related to enhancing trust in ML models, which has become a prominent topic of research in the visualization community over the past decades. To provide an overview and present the frontiers of current research on the topic, we present a State-of-the-Art Report (STAR) on enhancing trust in ML models with the use of interactive visualization. We define and describe the background of the topic, introduce a categorization for visualization techniques that aim to accomplish this goal, and discuss insights and opportunities for future research directions. Among our contributions is a categorization of trust against different facets of interactive ML, expanded and improved from previous research. Our results are investigated from different analytical perspectives: (a) providing a statistical overview, (b) summarizing key findings, (c) performing topic analyses, and (d) exploring the data sets used in the individual papers, all with the support of an interactive web-based survey browser. We intend this survey to be beneficial for visualization researchers whose interests involve making ML models more trustworthy, as well as researchers and practitioners from other disciplines in their search for effective visualization techniques suitable for solving their tasks with confidence and conveying meaning to their data.
引用
收藏
页码:713 / 756
页数:44
相关论文
共 449 条
  • [1] ClustMe: A Visual Quality Measure for Ranking Monochrome Scatterplots based on Cluster Patterns
    Abbas, Mostafa M.
    Aupetit, Michael
    Sedlmair, Michael
    Bensmail, Halima
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (03) : 225 - 236
  • [2] Adel T, 2018, PR MACH LEARN RES, V80
  • [3] AHMED Z., 2011, P EUROVIS WORKSH VIS, DOI [DOI 10.2312/PE/EUROVAST/EUROVA11/049-052.17, 10.2312/PE/EuroVAST/EuroVA11/049-052.17]
  • [4] Ahmed Z, 2012, IEEE CONF VIS ANAL, P13, DOI 10.1109/VAST.2012.6400493
  • [5] FairSight: Visual Analytics for Fairness in Decision Making
    Ahn, Yongsu
    Lin, Yu-Ru
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (01) : 1086 - 1095
  • [6] Albuquerque G., 2011, 2011 IEEE Conference on Visual Analytics Science and Technology, P13, DOI 10.1109/VAST.2011.6102437
  • [7] Alimoglu F, 1997, PROC INT CONF DOC, P637, DOI 10.1109/ICDAR.1997.620583
  • [8] Alpaydin E, 1998, KYBERNETIKA, V34, P369
  • [9] Do Convolutional Neural Networks Learn Class Hierarchy?
    Alsallakh, Bilal
    Jourabloo, Amin
    Ye, Mao
    Liu, Xiaoming
    Ren, Liu
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (01) : 152 - 162
  • [10] Visual Methods for Analyzing Probabilistic Classification Data
    Alsallakh, Bilal
    Hanbury, Allan
    Hauser, Helwig
    Miksch, Silvia
    Rauber, Andreas
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2014, 20 (12) : 1703 - 1712