Innovative approach to monitor performance of integrated disease surveillance and response after the Ebola outbreak in Sierra Leone: lessons from the field

Background Supervision of healthcare workers improves performance if done in a supportive and objective manner. Regular supervision is a support function of Integrated Disease Surveillance and Response (IDSR) strategy and allows systematic monitoring of IDSR implementation. Starting 2015, WHO and other development partners supported the Ministry of Health and Sanitation (MoHS) to revitalize IDSR in Sierra Leone and to monitor progress through supportive supervision assessments. We report on the findings of these assessments. Methods This was a cross-sectional study where six longitudinal assessments were conducted in randomly selected health facilities. Health facilities assessed were 71 in February 2016, 99 in July 2016, 101 in May 2017, 126 in August 2018, 139 in February 2019 and 156 in August 2021. An electronic checklist based on selected core functions of IDSR was developed and uploaded onto tablets using the Open Data Kit (ODK) platform. Supervision teams interviewed health care workers, reviewed documents and made observations in health facilities. Supervision books were used to record feedback and corrective actions. Data from the supervisory visits was downloaded from ODK platform, cleaned and analysed. Categorical data was summarized using frequencies and proportions while means and medians were used for continuous variables. Z test was used to test for differences in proportions. Results Completeness of IDSR reporting improved from 84.5% in 2016 to 96% in 2021 (11.5% points; 95% CI 3.6, 21.9; P-value 0.003). Timeliness of IDSR reports improved from 80.3 to 92% (11.7% points; 95% CI 2.4, 22.9; P-value 0.01). There was significant improvement in health worker knowledge of IDSR concepts and tools, in availability of IDSR standard case definition posters and reporting tools and in data analysis practices. Availability of vaccines and temperature monitoring tools in health facilities also improved significantly but some indicators dropped such as availability of IDSR technical guidelines and malaria testing kits and drugs. Conclusion Supervision using electronic tool contributed to health systems strengthening through longitudinal tracking of core IDSR indicators and other program indicators such as essential malaria commodities and availability and status of routine vaccines. Supervision using electronic tools should be extended to other programs.