Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis

被引:15
作者
Shan, Yi [1 ,4 ]
Ji, Meng [2 ]
Xie, Wenxiu [3 ]
Lam, Kam-Yiu [3 ]
Chow, Chi -Yin [3 ]
机构
[1] Nantong Univ, Nantong, Peoples R China
[2] Univ Sydney, Sydney, Australia
[3] City Univ Hong Kong, Hong Kong, Peoples R China
[4] Nantong Univ, 9 Seyuan Rd, Nantong 226019, Peoples R China
来源
JMIR HUMAN FACTORS | 2022年 / 9卷 / 04期
关键词
public trust; public opinion; AI application; artificial intelligence; mental health care; topic modeling; topic; theme; term; visualization; user feedback; user review; Google Play; health app; mHealth; mobile health; digital health; eHealth; mental health; mental illness; mental disorder; AUTOMATION; PHYSICIANS; ORGANIZATIONS; PROVIDERS; INTERNET; ILLNESS; STIGMA; PEOPLE; TEXT;
D O I
10.2196/38799
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background: Mental disorders (MDs) impose heavy burdens on health care (HC) systems and affect a growing number of people worldwide. The use of mobile health (mHealth) apps empowered by artificial intelligence (AI) is increasingly being resorted to as a possible solution.Objective: This study adopted a topic modeling (TM) approach to investigate the public trust in AI apps in mental health care (MHC) by identifying the dominant topics and themes in user reviews of the 8 most relevant mental health (MH) apps with the largest numbers of reviewers.Methods: We searched Google Play for the top MH apps with the largest numbers of reviewers, from which we selected the most relevant apps. Subsequently, we extracted data from user reviews posted from January 1, 2020, to April 2, 2022. After cleaning the extracted data using the Python text processing tool spaCy, we ascertained the optimal number of topics, drawing on the coherence scores and used latent Dirichlet allocation (LDA) TM to generate the most salient topics and related terms. We then classified the ascertained topics into different theme categories by plotting them onto a 2D plane via multidimensional scaling using the pyLDAvis visualization tool. Finally, we analyzed these topics and themes qualitatively to better understand the status of public trust in AI apps in MHC.Results: From the top 20 MH apps with the largest numbers of reviewers retrieved, we chose the 8 (40%) most relevant apps: (1) Wysa: Anxiety Therapy Chatbot; (2) Youper Therapy; (3) MindDoc: Your Companion; (4) TalkLife for Anxiety, Depression & Stress; (5) 7 Cups: Online Therapy for Mental Health & Anxiety; (6) BetterHelp-Therapy; (7) Sanvello; and (8) InnerHour. These apps provided 14.2% (n=559), 11.0% (n=431), 13.7% (n=538), 8.8% (n=356), 14.1% (n=554), 11.9% (n=468), 9.2% (n=362), and 16.9% (n=663) of the collected 3931 reviews, respectively. The 4 dominant topics were topic 4 (cheering people up; n=1069, 27%), topic 3 (calming people down; n=1029, 26%), topic 2 (helping figure out the inner world; n=963, 25%), and topic 1 (being an alternative or complement to a therapist; n=870, 22%). Based on topic coherence and intertopic distance, topics 3 and 4 were combined into theme 3 (dispelling negative emotions), while topics 2 and 1 remained 2 separate themes: theme 2 (helping figure out the inner world) and theme 1 (being an alternative or complement to a therapist), respectively. These themes and topics, though involving some dissenting voices, reflected an overall high status of trust in AI apps.Conclusions: This is the first study to investigate the public trust in AI apps in MHC from the perspective of user reviews using the TM technique. The automatic text analysis and complementary manual interpretation of the collected data allowed us to discover the dominant topics hidden in a data set and categorize these topics into different themes to reveal an overall high degree of public trust. The dissenting voices from users, though only a few, can serve as indicators for health providers and app developers to jointly improve these apps, which will ultimately facilitate the treatment of prevalent MDs and alleviate the overburdened HC systems worldwide.(JMIR Hum Factors 2022;9(4):e38799) doi: 10.2196/38799
引用
收藏
页数:12
相关论文
共 65 条
[1]   Improving IoT Technology Adoption through Improving Consumer Trust [J].
AlHogail, Areej .
TECHNOLOGIES, 2018, 6 (03)
[2]   The stigma of mental illness: effects of labelling on public attitudes towards people with mental disorder [J].
Angermeyer, MC ;
Matschinger, H .
ACTA PSYCHIATRICA SCANDINAVICA, 2003, 108 (04) :304-309
[3]  
[Anonymous], 1997, COMPUT MATH APPL, P128
[4]  
[Anonymous], 1983, The Logic and Limits of Trust
[5]   Perceived Helpfulness of Physicians' Communication Behavior and Breast Cancer Patients' Level of Trust Over Time [J].
Arora, Neeraj K. ;
Gustafson, David H. .
JOURNAL OF GENERAL INTERNAL MEDICINE, 2009, 24 (02) :252-255
[6]   Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians [J].
Asan, Onur ;
Bayrak, Alparslan Emrah ;
Choudhury, Avishek .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2020, 22 (06)
[7]   Trust in insurers and access to physicians: Associated enrollee behaviors and changes over time [J].
Balkrishnan, R ;
Hall, MA ;
Blackwelder, S ;
Bradley, D .
HEALTH SERVICES RESEARCH, 2004, 39 (04) :813-823
[8]   Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis [J].
Baumel, Amit ;
Muench, Frederick ;
Edan, Stav ;
Kane, John M. .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2019, 21 (09)
[9]   Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: An Observational Study of Siri, Alexa, and Google Assistant [J].
Bickmore, Timothy W. ;
Trinh, Ha ;
Olafsson, Stefan ;
O'Leary, Teresa K. ;
Asadi, Reza ;
Rickles, Nathaniel M. ;
Cruz, Ricardo .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2018, 20 (09)
[10]   Probabilistic Topic Models [J].
Blei, David M. .
COMMUNICATIONS OF THE ACM, 2012, 55 (04) :77-84