Replication of software engineering experiments

被引：0
作者：
Juristo N. [1 ]
Gómez O.S. [1 ]
机构：
[1] Facultad de Informática, Universidad Politécnica de Madrid, Madrid 28660, Boadilla del Monte
来源：
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 2011年 / 7007 LNCS卷
关键词：
Empirical Software Engineering; Experimental Replicaction; Experimental Software Engineering; Types of Replication;
D O I：
10.1007/978-3-642-25231-0_2
中图分类号：
学科分类号：
摘要：
Experimentation has played a major role in scientific advancement. Replication is one of the essentials of the experimental methods. In replications, experiments are repeated aiming to check their results. Successful replication increases the validity and reliability of the outcomes observed in an experiment. There is debate about the best way of running replications of Software Engineering (SE) experiments. Some of the questions that have cropped up in this debate are, "Should replicators reuse the baseline experiment materials? Which is the adequate sort of communication among experimenters and replicators if any? What elements of the experimental structure can be changed and still be considered a replication instead of a new experiment?". A deeper understanding of the concept of replication should help to clarify these issues as well as increase and improve replications in SE experimental practices. In this chapter, we study the concept of replication in order to gain insight. The chapter starts with an introduction to the importance of replication and the state of replication in ESE. Then we discuss replication from both the statistical and scientific viewpoint. Based on a review of the diverse types of replication used in other scientific disciplines, we identify the different types of replication that are feasible to be run in our discipline. Finally, we present the different purposes that replication can serve in Experimental Software Engineering (ESE). © 2012 Springer-Verlag Berlin Heidelberg.
引用
收藏
页码：60 / 88
页数：28
相关论文
共 86 条
  • [1] Tichy W., Should computer scientists experiment more?, Computer, 31, 5, pp. 32-40, (1998)
  • [2] Basili V., Shull F., Lanubile F., Building knowledge through families of experiments, IEEE Transactions on Software Engineering, 25, 4, pp. 456-473, (1999)
  • [3] DeMarco T., Software engineering: An idea whose time has come and gone?, IEEE Software, 26, 4, pp. 95-96, (2009)
  • [4] Meyer B., Credible objective answers to fundamental software engineering questions, LASER Summer School on Software Engineering, (2010)
  • [5] Meyer B., Empirical research: Questions from software engineering, 4th International Symposium on Empirical Software Engineering and Measurement (ESEM 2010, (2010)
  • [6] Brinberg D., McGrath J.E., Validity and the Research Process, (1985)
  • [7] Hayes W., Research synthesis in software engineering: A case for meta-analysis, METRICS 1999: Proceedings of the 6th International Symposium on Software Metrics, (1999)
  • [8] Miller J., Can Results from Software Engineering Experiments be Safely Combined? In: METRICS 1999: Proceedings of the 6th International Symposium on Software Metrics, (1999)
  • [9] Miller J., Applying meta-analytical procedures to software engineering experiments, J. Syst. Softw., 54, 1, pp. 29-39, (2000)
  • [10] Miller J., Replicating software engineering experiments: A poisoned chalice or the holy grail, Information and Software Technology, 47, 4, pp. 233-244, (2005)
123456789