Evaluating an Interactive Memory Analysis Tool: Findings from a Cognitive Walkthrough and a User Study

被引：10
作者：
Weninger M. [1 ]
Grünbacher P. [1 ]
Gander E. [2 ]
Schörgenhumer A. [2 ]
机构：
[1] Institute for System Software, Johannes Kepler University Linz, Altenberger Strabe 69, Linz
[2] Christian Doppler Laboratory MEVSS, Johannes Kepler University Linz, Altenberger Strabe 69, Linz
来源：
Proceedings of the ACM on Human-Computer Interaction | 2020年 / 4卷 / EICS期
关键词：
assessment; cognitive dimensions; cognitive walkthrough; interactive memory analysis tools; usability; usefulness; user study; utility;
D O I：
10.1145/3394977
中图分类号：
TB18 [人体工程学]; Q98 [人类学];
学科分类号：
030303 ; 1201 ;
摘要：
Memory analysis tools are essential for finding and fixing anomalies in the memory usage of software systems (e.g., memory leaks). Although numerous tools are available, hardly any empirical studies exist on their usefulness for developers in typical usage scenarios. Instead, most evaluations are limited to reporting performance metrics. We thus conducted a study to empirically assess the usefulness of the interactive memory analysis tool AntTracks Analyzer. Specifically, we first report findings from assessing the tool using a cognitive walkthrough, guided by the Cognitive Dimensions of Notations Framework. We then present the results of a qualitative user study involving 14 subjects who used AntTracks to detect and resolve memory anomalies. We report lessons learned from the study and implications for developers of interactive memory analysis tools. We hope that our results will help researchers and developers of memory analysis tools in defining, selecting, and improving tool capabilities. © 2020 ACM.
引用
收藏
相关论文
共 114 条
[1]  
Abran A., Khelifi A., Suryn W., Seffah A., Usability meanings and interpretations in iso standards, Software Quality Journal, 11, 4, pp. 325-338, (2003)
[2]  
Aftandilian E., Kelley S., Gramazio C., Ricci N.P., Su S.L., Guyer S.Z., Heapviz: Interactive heap visualization for program understanding and debugging, Proceedings of the Acm 2010 Symposium on Software Visualization, pp. 53-62, (2010)
[3]  
Baltes S., Schmitz P., Diehl S., Linking sketches and diagrams to source code artifacts, Proceedings of the 22nd Acm Sigsoft International Symposium on Foundations of Software Engineering (FSE-22), pp. 743-746, (2014)
[4]  
Bellingham M., Holland S., Mulholland P., A cognitive dimensions analysis of interaction design for algorithmic composition software, Proceedings of the 25th Annual Workshop of the Psychology of Programming Interest Group, Ppig 2014, 18, (2014)
[5]  
Bitto V., Lengauer P., Building custom, efficient, and accurate memory monitoring tools for Java applications, Proceedings of the 7th ACM/SPEC International Conference on Performance Engineering, Icpe 2016, pp. 321-324, (2016)
[6]  
Bitto V., Lengauer P., Mossenbock H., Efficient rebuilding of large Java heaps from event traces, Proceedings of the Principles and Practices of Programming on the Java Platform, Pppj 2015, pp. 76-89, (2015)
[7]  
Blackwell A., Green T., CHAPTER 5-notational systems-The cognitive dimensions of notations framework, Hci Models, Theories, and Frameworks, pp. 103-133, (2003)
[8]  
Blackwell A.F., Cognitive dimensions of notations, 2005 Ieee Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2005), 3, (2005)
[9]  
Blackwell A.F., Cognitive dimensions of notations: Understanding the ergonomics of diagram use, Diagrammatic Representation and Inference, 5th International Conference, Diagrams 2008, Herrsching, Germany, September 19-21, 2008. Proceedings, pp. 5-8, (2008)
[10]  
Blackwell A.F., Britton C., Cox A.L., Green G.T.R., Gurr C.A., Kadoda G.F., Kutar M., Loomes M., Nehaniv C.L., Petre M., Roast C., Roe C., Wong A., Young R.M., Cognitive dimensions of notations: Design tools for cognitive technology, Cognitive Technology: Instruments of Mind, 4th International Conference, Ct 2001, pp. 325-341, (2001)
12345678910