Replication of software engineering experiments

被引：0
作者：
Juristo N. [1 ]
Gómez O.S. [1 ]
机构：
[1] Facultad de Informática, Universidad Politécnica de Madrid, Madrid 28660, Boadilla del Monte
来源：
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 2011年 / 7007 LNCS卷
关键词：
Empirical Software Engineering; Experimental Replicaction; Experimental Software Engineering; Types of Replication;
D O I：
10.1007/978-3-642-25231-0_2
中图分类号：
学科分类号：
摘要：
Experimentation has played a major role in scientific advancement. Replication is one of the essentials of the experimental methods. In replications, experiments are repeated aiming to check their results. Successful replication increases the validity and reliability of the outcomes observed in an experiment. There is debate about the best way of running replications of Software Engineering (SE) experiments. Some of the questions that have cropped up in this debate are, "Should replicators reuse the baseline experiment materials? Which is the adequate sort of communication among experimenters and replicators if any? What elements of the experimental structure can be changed and still be considered a replication instead of a new experiment?". A deeper understanding of the concept of replication should help to clarify these issues as well as increase and improve replications in SE experimental practices. In this chapter, we study the concept of replication in order to gain insight. The chapter starts with an introduction to the importance of replication and the state of replication in ESE. Then we discuss replication from both the statistical and scientific viewpoint. Based on a review of the diverse types of replication used in other scientific disciplines, we identify the different types of replication that are feasible to be run in our discipline. Finally, we present the different purposes that replication can serve in Experimental Software Engineering (ESE). © 2012 Springer-Verlag Berlin Heidelberg.
引用
收藏
页码：60 / 88
页数：28
相关论文
共 86 条
[11]  
Hannay J., Dyba T., Arisholm E., Sjoberg D., The effectiveness of pair programming: A meta-analysis, Information and Software Technology Special Section: Software Engineering for Secure Systems, 51, 7, pp. 1110-1122, (2009)
[12]  
Jorgensen M., A review of studies on expert estimation of software development effort, Journal of Systems and Software, 70, 1-2, pp. 37-60, (2004)
[13]  
Pickard L., Kitchenham B., Jones P., Combining empirical results in software engineering, Information and Software Technology, 40, 14, pp. 811-821, (1998)
[14]  
Shull F., Basili V., Carver J., Maldonado J., Travassos G., Mendonca M., Fabbri S., Replicating software engineering experiments: Addressing the tacit knowledge problem, SESE 2002: Proceedings of the 2002 International Symposium on Empirical Software Engineering, (2002)
[15]  
Juristo N., Moreno A., Vegas S., Reviewing 25 years of testing technique experiments, Empirical Softw. Engg., 9, 1-2, pp. 7-44, (2004)
[16]  
Basili V., Selby R., Comparing the effectiveness of software testing strategies, IEEE Trans. Softw. Eng., 13, 12, pp. 1278-1296, (1987)
[17]  
Porter A., Votta L., Basili V., Comparing detection methods for software requirements inspections: A replicated experiment, IEEE Trans. Softw. Eng., 21, 6, pp. 563-575, (1995)
[18]  
Fusaro P., Lanubile F., Visaggio G., A replicated experiment to assess requirements inspectiontechniques, Empirical Softw. Engg., 2, 1, pp. 39-57, (1997)
[19]  
Miller J., Wood M., Roper M., Further experiences with scenarios and checklists, Empirical Software Engineering, 3, 1, pp. 37-64, (1998)
[20]  
Sandahl K., Blomkvist O., Karlsson J., Krysander C., Lindvall M., Ohlsson N., An extended replication of an experiment for assessing methods for software requirements inspections, Empirical Software Engineering, 3, 4, pp. 327-354, (1998)
123456789