What is measured matters: A scoping review of analysis methods used for qualitative patient reported experience measure data

Introduction: Hospitals are increasingly turning to patients for valuable feedback regarding their care experience. A common method to collect this information is patient reported experience measures (PREMs) surveys. Health care workers report qualitative PREMs as more interesting, relevant, and informative than quantitative survey responses. However, a major barrier to utilising qualitative PREMs data to drive quality improvements is a lack of resources to analyse the data. This scoping review aimed to review the methods used to analyse qualitative PREMs survey data from routine hospital care. Methods: We utilised the JBI scoping review methodology, and searched four databases for articles from 2013 to 2023 which analysed qualitative PREMs survey data from routine care in hospitals. Study characteristics were extracted, as well as the analysis method - specifically, whether the study used traditional manual analysis methods in which the researcher reads the text and categorise the data, or automated methods utilising computers and algorithms to read and categorise the data. Results: From 960 unique articles, 123 went through full-text review and 54 were deemed eligible. 75.9 % used only manual content analysis methods to analyse the qualitative responses, 16.7 % of studies used a combination of manual and automated methods, and only 7.4 % used exclusively automated methods. Automated methods were used in 27.5 % of studies published 2019-2023, compared to 14.3 % of studies published 2013-2018. All bar one study using automated methods focused on investigating the validity of the automated methodology or used it to complement manual content analysis. Conclusion: The studies included in this review show a transition from traditional time-consuming manual analyses to computerised methods enabling analysis at a larger scale. As the volume of PREMs data collected grows, efficient and effective ways to analyse qualitative PREMs data at scale are required to enable health services to capture the patient voice and drive consumer-centred improvements in care.