Validation of a Questionnaire to Assess the Usability of and User Experience with Mobile Health Applications

Background/objectives: The growing use of mobile health (mHealth) applications needs reliable tools to assess their usability and user experience in clinical practice to improve the digital health (eHealth) interventions and ensure engagement, as higher engagement is often linked to increased efficacy of healthcare interventions. This study aimed to validate the patient Satisfaction and Usability with APPs questionnaire (pSUAPP), a multidimensional tool designed for the comprehensive assessment of mHealth applications, particularly for the integrated follow-up of patients with chronic diseases. Methods: A validation study was conducted between August and December 2022 with 85 participants from two hospitals in Spain, who completed the pSUAPP questionnaire, comprising 27 Likert-like items across four dimensions: first contact, registration, features and overall experience, and 1 open question. The questionnaire was validated by a panel of 11 experts and further assessed for psychometric properties. Results: The mean pSUAPP score was 79.0 (SD = 12.0), indicating high usability and positive user experience, with the highest scores in the 'features' dimension. The pSUAPP demonstrated moderate correlation with the System Usability Scale (SUS) and high reliability (Cronbach's alpha and omega t > 0.9). A reproducibility analysis showed negligible changes between repeated measures. Conclusions: The pSUAPP questionnaire was found to be a robust tool for evaluating mHealth app usability and user experience, with potential application across various clinical settings.