How do we know that research ethics committees are really working? the neglected role of outcomes assessment in research ethics review

Background. Countries are increasingly devoting significant resources to creating or strengthening research ethics committees, but there has been insufficient attention to assessing whether these committees are actually improving the protection of human research participants. Discussion. Research ethics committees face numerous obstacles to achieving their goal of improving research participant protection. These include the inherently amorphous nature of ethics review, the tendency of regulatory systems to encourage a focus on form over substance, financial and resource constraints, and conflicts of interest. Auditing and accreditation programs can improve the quality of ethics review by encouraging the development of standardized policies and procedures, promoting a common base of knowledge, and enhancing the status of research ethics committees within their own institutions. However, these mechanisms focus largely on questions of structure and process and are therefore incapable of answering many critical questions about ethics committees' actual impact on research practices. The first step in determining whether research ethics committees are achieving their intended function is to identify what prospective research participants and their communities hope to get out of the ethics review process. Answers to this question can help guide the development of effective outcomes assessment measures. It is also important to determine whether research ethics committees' guidance to investigators is actually being followed. Finally, the information developed through outcomes assessment must be disseminated to key decision-makers and incorporated into practice. This article offers concrete suggestions for achieving these goals. Conclusion. Outcomes assessment of research ethics committees should address the following questions: First, does research ethics committee review improve participants' understanding of the risks and potential benefits of studies? Second, does the process affect prospective participants' decisions about whether to participate in research? Third, does it change participants' subjective experiences in studies or their attitudes about research? Fourth, does it reduce the riskiness of research? Fifth, does it result in more research responsive to the local community's self-identified needs? Sixth, is research ethics committees' guidance to researchers actually being followed? © 2008 Coleman and Bouësseau; licensee BioMed Central Ltd.