Reflecting on the Evaluation of Visualization Authoring Systems

被引:0
|
作者
Ren, Donghao [1 ]
Lee, Bongshin [2 ]
Brehmer, Matthew [2 ]
Riche, Nathalie Henry [2 ]
机构
[1] Univ Calif Santa Barbara, Santa Barbara, CA 93106 USA
[2] Microsoft Res, Redmond, WA USA
来源
2018 IEEE EVALUATION AND BEYOND - METHODOLOGICAL APPROACHES FOR VISUALIZATION (BELIV) | 2018年
关键词
Human-centered computing; Visualization; Visualization design and evaluation methods; INFORMATION VISUALIZATION; DESIGN; TOOLS; TIME;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we discuss the challenges one faces when evaluating authoring systems developed to help people design visualization for communication purposes. We reflect on our own experiences in evaluating the visualization authoring systems that we have developed as well as the evaluation methods used in other recent projects. We also examine alternative approaches for evaluating visualization authoring systems that we believe to be more appropriate than traditional comparative studies. We hope that our discussion is informative, not only for researchers who intend to develop novel visualization authoring systems, but also for reviewers assigned to evaluate the research contributions of these systems. Our discussion concludes with opportunities for facilitating the evaluation and adoption of deployed visualization authoring systems.
引用
收藏
页码:86 / 92
页数:7
相关论文
共 50 条
  • [21] AVIoT: Web-Based Interactive Authoring and Visualization of Indoor Internet of Things
    Jeong, Yuna
    Joo, Hyuntae
    Hong, Gyeonghwan
    Shin, Dongkun
    Lee, Sungkil
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2015, 61 (03) : 295 - 301
  • [22] An operator interaction framework for visualization systems
    Chi, EHH
    Riedl, JT
    IEEE SYMPOSIUM ON INFORMATION VISUALIZATION - PROCEEDINGS, 1998, : 63 - 70
  • [23] ExoplanetExplorer: Contextual Visualization of Exoplanet Systems
    Broman, Emma
    Faherty, Jacqueline
    Kreidberg, Laura
    Zieba, Sebastian
    Hansen, Charles
    Ynnerman, Anders
    Bock, Alexander
    2023 IEEE VISUALIZATION AND VISUAL ANALYTICS, VIS, 2023, : 81 - 85
  • [24] Authoring WCAG2.0-Compliant Texts for the Web Through Text Readability Visualization
    Eika, Evelyn
    Sandnes, Frode Eika
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION; METHODS, TECHNIQUES, AND BEST PRACTICES, PT I, 2016, 9737 : 49 - 58
  • [25] Evaluating User Experience in Information Visualization Systems: UXIV an Evaluation Questionnaire
    Victorelli, Eliane Zambon
    dos Reis, Julio Cesar
    HUMAN INTERFACE AND THE MANAGEMENT OF INFORMATION, HIMI 2023, PT I, 2023, 14015 : 320 - 338
  • [26] WYSIWYM - Integrated visualization, exploration and authoring of semantically enriched un-structured content
    Khalili, Ali
    Auer, Soeren
    SEMANTIC WEB, 2015, 6 (03) : 259 - 275
  • [27] Design and Evaluation Techniques for Authoring Interactive and Stylistic Behaviors
    Young, James E.
    Igarashi, Takeo
    Sharlin, Ehud
    Sakamoto, Daisuke
    Allen, Jeffrey
    ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2014, 3 (04)
  • [28] Evaluation of current visualization tools for cyber security
    Langton, John T.
    Newey, Brent
    CYBER SECURITY, SITUATION MANAGEMENT, AND IMPACT ASSESSMENT II; AND VISUAL ANALYTICS FOR HOMELAND DEFENSE AND SECURITY II, 2010, 7709
  • [29] A systematic literature review of software visualization evaluation
    Merino, L.
    Ghafari, M.
    Anslow, C.
    Nierstrasz, O.
    JOURNAL OF SYSTEMS AND SOFTWARE, 2018, 144 : 165 - 180
  • [30] Visualization support for virtual redesign of manufacturing systems
    Lindskog, Erik
    Berglund, Jonatan
    Vallhagen, Johan
    Johansson, Bjorn
    FORTY SIXTH CIRP CONFERENCE ON MANUFACTURING SYSTEMS 2013, 2013, 7 : 419 - 424