Software inspections: comparing a formal method based with a classical reading methodology

In this paper, we present a rigorous comparison of two inspection techniques: our formal method-based approach, SOLIMVA 3.0, with a set of Object-Oriented Reading Techniques (OORTs). We evaluated efficiency (required time to analyse a scenario) and effectiveness (ability to find defects within UML diagrams). Results show that the classical OORT methodology is more efficient than SOLIMVA. However, we found a strong positive correlation between the required time by using OORT and SOLIMVA. For effectiveness, in general, both methodologies presented the same performance. However, SOLIMVA detected more inconsistency (incorrectness and extra information), ambiguity, and partial incompleteness defects while OORT identified more total incompleteness. Our overall conclusion is that a classical reading methodology (OORT) and a formal-based one (SOLIMVA) can be adopted in a complementary way within a software inspection process. While OORT is less costly to apply, SOLIMVA can be used to address some specific types of defects.