Using key component profiles for the evaluation of program implementation in intensive mental health case management

Despite increasing interest in process evaluation and the development of a variety of approaches to assess program implementation, several methodological challenges remain. Of particular concern is the development of ways not only to adequately determine the extent to which programs are implemented as intended but the provision of effective means to use such information in explaining observed variation in program outcomes. Following a review and critique of the process evaluation literature, particularly in the domain of community mental health, the paper introduces the use of 'key component profiles' (KCP) as an alternative methodological approach to evaluating program implementation. A case application in the context of an intensive case management program for meeting the needs of clients with severe mental illness who are homeless is described. The steps in developing the multiple dimension profile of program implementation are detailed and validation data provided. The results are discussed in terms of their implications for use within the local context and, more generally, the use of KCPs for process evaluation. (C) 2004 Elsevier Ltd. All rights reserved.