EVALUATION OF A BUSINESS INTELLIGENCE MATURITY MODEL: THE RELIABILITY PERSPECTIVE

To support the systematic evolution and improvement of business intelligence (BI) as an enterprise wide capability of strategic importance, a BI maturity model (MM) and a maturity measurement instrument were proposed in prior research. But to demonstrate that the developed maturity model achieves the design purpose, evaluation is an essential step. In this paper, a comprehensive evaluation strategy is proposed to evaluate the artifact in two steps. In addition, the first phase of evaluation, which deals with reliability of the measurement instrument, is performed. In fact, reliability of the maturity measurement instrument is established using the three measures internal consistency, item-total correlation, and convergent validity. The evaluation therefore represents a cross-research paradigm, bringing additional benefits, as results are used to inform the second phase of evaluation concerned with utility of the artifact. Findings are that the BI MM together with its measurement instrument can be considered reliable, although issues were discovered regarding the maturity dimensions organization and use. These issues are subject to further investigation and improvement in the second phase of evaluation.