GANViz: A Visual Analytics Approach to Understand the Adversarial Game

被引:64
作者
Wang, Junpeng [1 ]
Gou, Liang [2 ]
Yang, Hao [3 ]
Shen, Han-Wei [1 ]
机构
[1] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA
[2] Visa Res, Data Analyt Team, Palo Alto, CA 94306 USA
[3] Visa Res, Data Analyt, Palo Alto, CA 94306 USA
基金
美国国家科学基金会;
关键词
Generative adversarial nets; deep learning; model interpretation; visual analytics;
D O I
10.1109/TVCG.2018.2816223
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generative models bear promising implications to learn data representations in an unsupervised fashion with deep learning. Generative Adversarial Nets (GAN) is one of the most popular frameworks in this arena. Despite the promising results from different types of GANs, in-depth understanding on the adversarial training process of the models remains a challenge to domain experts. The complexity and the potential long-time training process of the models make it hard to evaluate, interpret, and optimize them. In this work, guided by practical needs from domain experts, we design and develop a visual analytics system, GANViz, aiming to help experts understand the adversarial process of GANs in-depth. Specifically, GANViz evaluates the model performance of two subnetworks of GANs, provides evidence and interpretations of the models' performance, and empowers comparative analysis with the evidence. Through our case studies with two real-world datasets, we demonstrate that GANViz can provide useful insight into helping domain experts understand, interpret, evaluate, and potentially improve GAN models.
引用
收藏
页码:1905 / 1917
页数:13
相关论文
共 29 条
[21]  
Radford A., 2015, COMPUTER SCI
[22]  
Shlens J., 2016, Conditional image synthesis with auxiliary classifier gans, DOI DOI 10.1109/LGRS.2018.2868704
[23]   The eyes have it: A task by data type taxonomy for information visualizations [J].
Shneiderman, B .
IEEE SYMPOSIUM ON VISUAL LANGUAGES, PROCEEDINGS, 1996, :336-343
[24]   LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks [J].
Strobelt, Hendrik ;
Gehrmann, Sebastian ;
Pfister, Hanspeter ;
Rush, Alexander M. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2018, 24 (01) :667-676
[25]  
Tzeng FY, 2005, IEEE VISUALIZATION 2005, PROCEEDINGS, P383
[26]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579
[27]   Multi-Resolution Climate Ensemble Parameter Analysis with Nested Parallel Coordinates Plots [J].
Wang, Junpeng ;
Liu, Xiaotong ;
Shen, Han-Wei ;
Lin, Guang .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2017, 23 (01) :81-90
[28]   Image quality assessment: From error visibility to structural similarity [J].
Wang, Z ;
Bovik, AC ;
Sheikh, HR ;
Simoncelli, EP .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) :600-612
[29]   Visualizing and Understanding Convolutional Networks [J].
Zeiler, Matthew D. ;
Fergus, Rob .
COMPUTER VISION - ECCV 2014, PT I, 2014, 8689 :818-833