A decision-analytic stopping rule for validation of commercial software systems

被引:16
作者
Chávez, T [1 ]
机构
[1] Rapt Technol Corp, San Francisco, CA 94107 USA
关键词
software testing; reliability; decision analysis; Bayesian statistics; commercial software development;
D O I
10.1109/32.877849
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The decision about when to release a software product commercially is not a question of when the software has attained some objectively justifiable degree of correctness. It is, rather, a question of whether the software achieves a reasonable balance among engineering objectives, market demand, customer requirements, and marketing directives of the software organization. In this paper, we present a rigorous framework for addressing this important decision. Conjugate distributions from statistical decision theory provide an attractive means of modeling the cost and rate of bugs given information acquired during software testing, as well as prior information provided by software engineers about the fidelity of the software before testing begins. In contrast to methods such as [1] and [15], the stopping analysis presented here yields a computationally simple rule for deciding when to release a commercial software product based on information revealed to engineers during software testing-complicated numerical procedures are not needed. Our method has the added benefits that it is sequential: It measures explicitly the costs of customer dissatisfaction associated with bugs as well as the costs of declining market position while the testing process continues; and it incorporates a practical framework for cost-criticality assessment that makes sense to professional software developers. A probabilistic model of catastrophic bugs provides another useful way of characterizing and measuring the software's expected performance after commercial release. Taken together, these tools provide a software organization with a clearer basis for making decisions about when to release a commercial software product.
引用
收藏
页码:907 / 918
页数:12
相关论文
共 20 条
  • [1] CAMPODONICO S, 1994, IEEE T SOFTWARE ENG, V20
  • [2] DALAL S, 1994, IEEE T SOFTWARE ENG, V20
  • [3] WHEN SHOULD ONE STOP TESTING SOFTWARE
    DALAL, SR
    MALLOWS, CL
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1988, 83 (403) : 872 - 879
  • [4] DeGroot M., 1970, OPTIMAL STAT DECISIO
  • [5] GRANGER MG, 1990, UNCERTAINTY GUIDE DE
  • [6] HECKERMAN D, 1995, 9506 MICR
  • [7] HOWARD R, 1983, PRINCIPLES APPL DECI
  • [8] HOWARD RA, 1989, MANAGEMENT SCI, V35
  • [9] Moore GA, 2014, Crossing the chasm
  • [10] Musa J. D., 1987, Software Reliability, Measurement, Prediction, Application