Reflecting on the Evaluation of Visualization Authoring Systems

被引:0
|
作者
Ren, Donghao [1 ]
Lee, Bongshin [2 ]
Brehmer, Matthew [2 ]
Riche, Nathalie Henry [2 ]
机构
[1] Univ Calif Santa Barbara, Santa Barbara, CA 93106 USA
[2] Microsoft Res, Redmond, WA USA
来源
2018 IEEE EVALUATION AND BEYOND - METHODOLOGICAL APPROACHES FOR VISUALIZATION (BELIV) | 2018年
关键词
Human-centered computing; Visualization; Visualization design and evaluation methods; INFORMATION VISUALIZATION; DESIGN; TOOLS; TIME;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we discuss the challenges one faces when evaluating authoring systems developed to help people design visualization for communication purposes. We reflect on our own experiences in evaluating the visualization authoring systems that we have developed as well as the evaluation methods used in other recent projects. We also examine alternative approaches for evaluating visualization authoring systems that we believe to be more appropriate than traditional comparative studies. We hope that our discussion is informative, not only for researchers who intend to develop novel visualization authoring systems, but also for reviewers assigned to evaluate the research contributions of these systems. Our discussion concludes with opportunities for facilitating the evaluation and adoption of deployed visualization authoring systems.
引用
收藏
页码:86 / 92
页数:7
相关论文
共 50 条
  • [31] Evaluation of Security Information and Event Management Systems for Custom Security Visualization Generation
    Sonmez, Ferda Ozdemir
    Gunel, Banu
    2018 INTERNATIONAL CONGRESS ON BIG DATA, DEEP LEARNING AND FIGHTING CYBER TERRORISM (IBIGDELFT), 2018, : 38 - 44
  • [32] Visualization of dynamical systems
    Gröller, E
    Löffelmann, H
    Wegenkittl, R
    FUTURE GENERATION COMPUTER SYSTEMS, 1999, 15 (01) : 75 - 86
  • [34] A Crowdsourcing System for Integrated and Reproducible Evaluation in Scientific Visualization
    Englund, Rickard
    Kottravel, Sathish
    Ropinski, Timo
    2016 IEEE PACIFIC VISUALIZATION SYMPOSIUM (PACIFICVIS), 2016, : 40 - 47
  • [35] Evaluation of Information Visualization Tools Using the NFR Approach
    Kumar, Pushpa
    Subramanian, Nary
    Zhang, Kang
    VISUAL INFORMATION SYSTEMS: WEB-BASED VISUAL INFORMATION SEARCH AND MANAGEMENT, VISUAL 2008, 2008, 5188 : 44 - +
  • [36] ESTIMATION OF CHANNELS IN SYSTEMS WITH INTELLIGENT REFLECTING SURFACES
    Joham, Michael
    Gao, Hangze
    Utschick, Wolfgang
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5368 - 5372
  • [37] Information visualization evaluation in large companies: Challenges, experiences and recommendations
    Sedlmair, Michael
    Isenberg, Petra
    Baur, Dominikus
    Butz, Andreas
    INFORMATION VISUALIZATION, 2011, 10 (03) : 248 - 266
  • [38] THE USE OF VISUALIZATION IN AIRCRAFT DESIGN NODES BY USING CAX SYSTEMS
    Korba, Peter
    Pil'a, Jan
    Fozo, Ladislav
    Cibereova, Jana
    GEOCONFERENCE ON INFORMATICS, GEOINFORMATICS AND REMOTE SENSING, VOL I, 2014, : 399 - 406
  • [39] An Examination of the Relationship Between Visualization Media and Consumer Product Evaluation
    Palacios-Ibanez, Almudena
    Pirault, Simon
    Ochando-Marti, Francesc
    Contero, Manuel
    Camba, Jorge D.
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) : 3636 - 3649
  • [40] Visualization Support for Requirements Monitoring in Systems of Systems
    Kritzinger, Lisa Maria
    Krismayer, Thomas
    Vierhauser, Michael
    Rabiser, Rick
    Gruenbacher, Paul
    PROCEEDINGS OF THE 2017 32ND IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE'17), 2017, : 889 - 894