Visualization for Trust in Machine Learning Revisited: The State of the Field in 2023

被引:6
作者
Chatzimparmpas, Angelos [1 ]
Kucher, Kostiantyn [2 ]
Kerren, Andreas [2 ]
机构
[1] Northwestern Univ, Dept Comp Sci, Evanston, IL 60208 USA
[2] Linkoping Univ, Dept Sci & Technol, S-60174 Norrkoping, Sweden
关键词
Surveys; Stars; Data visualization; Browsers; Market research; Industries; Conferences; VISUAL ANALYTICS;
D O I
10.1109/MCG.2024.3360881
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Visualization for explainable and trustworthy machine learning remains one of the most important and heavily researched fields within information visualization and visual analytics with various application domains, such as medicine, finance, and bioinformatics. After our 2020 state-of-the-art report comprising 200 techniques, we have persistently collected peer-reviewed articles describing visualization techniques, categorized them based on the previously established categorization schema consisting of 119 categories, and provided the resulting collection of 542 techniques in an online survey browser. In this survey article, we present the updated findings of new analyses of this dataset as of fall 2023 and discuss trends, insights, and eight open challenges for using visualizations in machine learning. Our results corroborate the rapidly growing trend of visualization techniques for increasing trust in machine learning models in the past three years, with visualization found to help improve popular model explainability methods and check new deep learning architectures, for instance.
引用
收藏
页码:99 / 113
页数:15
相关论文
共 34 条
[1]   A survey of visual analytics for Explainable Artificial Intelligence methods [J].
Alicioglu, Gulsum ;
Sun, Bo .
COMPUTERS & GRAPHICS-UK, 2022, 102 :502-520
[2]   Visual Analytics for Human-Centered Machine Learning [J].
Andrienko, Natalia ;
Andrienko, Gennady ;
Adilova, Linara ;
Wrobel, Stefan .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2022, 42 (01) :123-133
[3]  
Angelini G., 2023, IEEE T VIS COMPUT GR, P1
[4]   The Role of Interactive Visualization in Fostering Trust in AI [J].
Beauxis-Aussalet, Emma ;
Behrisch, Michael ;
Borgo, Rita ;
Chau, Duen Horng ;
Collins, Christopher ;
Ebert, David ;
El-Assady, Mennatallah ;
Endert, Alex ;
Keim, Daniel A. ;
Kohlhammer, Joern ;
Oelke, Daniela ;
Peltonen, Jaakko ;
Riveiro, Maria ;
Schreck, Tobias ;
Strobelt, Hendrik ;
van Wijk, Jarke J. .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2021, 41 (06) :7-12
[5]   Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning [J].
Cabrera, Angel Alexander ;
Fu, Erica ;
Bertucci, Donald ;
Holstein, Kenneth ;
Talwalkar, Ameet ;
Hong, Jason I. ;
Perer, Adam .
PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2023), 2023,
[6]   The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations [J].
Chatzimparmpas, A. ;
Martins, R. M. ;
Jusufi, I. ;
Kucher, K. ;
Rossi, F. ;
Kerren, A. .
COMPUTER GRAPHICS FORUM, 2020, 39 (03) :713-756
[7]  
Chatzimparmpas R., 2020, Inf. Vis., V19, P9
[8]   A Visual Analysis Method for Predicting Material Properties Based on Uncertainty [J].
Chu, Qikai ;
Zhang, Lingli ;
He, Zhouqiao ;
Wu, Yadong ;
Zhang, Weihan .
APPLIED SCIENCES-BASEL, 2023, 13 (08)
[9]   LEMON: Alternative Sampling for More Faithful Explanation Through Local Surrogate Models [J].
Collaris, Dennis ;
Gajane, Pratik ;
Jorritsma, Joost ;
van Wijk, Jarke J. ;
Pechenizkiy, Mykola .
ADVANCES IN INTELLIGENT DATA ANALYSIS XXI, IDA 2023, 2023, 13876 :77-90
[10]   Which Biases and Reasoning Pitfalls Do Explanations Trigger? Decomposing Communication Processes in Human-AI Interaction [J].
El-Assady, Mennatallah ;
Moruzzi, Caterina .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2022, 42 (06) :11-23