Machine-Learning-Based Prediction of Client Distress From Session Recordings

被引:9
作者
Kuo, Patty B. [1 ]
Tanana, Michael J. [1 ]
Goldberg, Simon B. [2 ]
Caperton, Derek D. [1 ,3 ]
Narayanan, Shrikanth [4 ]
Atkins, David C. [5 ]
Imel, Zac E. [1 ]
机构
[1] Univ Utah, Dept Educ Psychol, Salt Lake City, UT 84112 USA
[2] Univ Wisconsin, Madison, WI USA
[3] Calgary Counselling Ctr, Calgary, AB, Canada
[4] Univ Southern Calif, Ming Hsieh Dept Elect & Comp Engn, Los Angeles, CA USA
[5] Univ Washington, Dept Psychiat, Seattle, WA USA
关键词
machine learning; natural language processing; outcome prediction; psychotherapy; PSYCHOTHERAPY PROCESS; SYNCHRONY; ALLIANCE; OUTCOMES; QUALITY;
D O I
10.1177/21677026231172694
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Natural language processing (NLP) is a subfield of machine learning that may facilitate the evaluation of therapist-client interactions and provide feedback to therapists on client outcomes on a large scale. However, there have been limited studies applying NLP models to client-outcome prediction that have (a) used transcripts of therapist-client interactions as direct predictors of client-symptom improvement, (b) accounted for contextual linguistic complexities, and (c) used best practices in classical training and test splits in model development. Using 2,630 session recordings from 795 clients and 56 therapists, we developed NLP models that directly predicted client symptoms of a given session based on session recordings of the previous session (Spearman's rho = .32, p < .001). Our results highlight the potential for NLP models to be implemented in outcome-monitoring systems to improve quality of care. We discuss implications for future research and applications.
引用
收藏
页码:435 / 446
页数:12
相关论文
共 53 条
[1]   Automated Text Messaging as an Adjunct to Cognitive Behavioral Therapy for Depression: A Clinical Trial [J].
Aguilera, Adrian ;
Bruehlman-Senecal, Emma ;
Demasi, Orianna ;
Avila, Patricia .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2017, 19 (05)
[2]   Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification [J].
Atkins, David C. ;
Steyvers, Mark ;
Imel, Zac E. ;
Smyth, Padhraic .
IMPLEMENTATION SCIENCE, 2014, 9
[3]   Using Topic Models to Identify Clients' Functioning Levels and Alliance Ruptures in Psychotherapy [J].
Atzil-Slonim, Dana ;
Juravski, Daniel ;
Bar-Kalifa, Eran ;
Gilboa-Schechtman, Eva ;
Tuval-Mashiach, Rivka ;
Shapira, Natalie ;
Goldberg, Yoav .
PSYCHOTHERAPY, 2021, 58 (02) :324-339
[4]  
Barde BV, 2017, 2017 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS), P745, DOI 10.1109/ICCONS.2017.8250563
[5]  
Belinkov Yonatan, 2020, P 58 ANN M ASS COMPU, P1, DOI [DOI 10.18653/V1/2020.ACL-TUTORIALS.1, 10.18653/v1/2020.acl-tutorials.1]
[6]   Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions [J].
Boswell, James F. ;
Kraus, David R. ;
Miller, Scott D. ;
Lambert, Michael J. .
PSYCHOTHERAPY RESEARCH, 2015, 25 (01) :6-19
[7]  
Boulianne D., 2011, IEEE 2011 WORKSH AUT, P1, DOI DOI 10.1017/CBO9781107415324.004
[8]   Knowledge and Attitudes Toward an Artificial Intelligence-Based Fidelity Measurement in Community Cognitive Behavioral Therapy Supervision [J].
Creed, Torrey A. ;
Kuo, Patty B. ;
Oziel, Rebecca ;
Reich, Danielle ;
Thomas, Margaret ;
O'Connor, Sydne ;
Imel, Zac E. ;
Hirsch, Tad ;
Narayanan, Shrikanth ;
Atkins, David C. .
ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH, 2022, 49 (03) :343-356
[9]  
Dai Z., 2019, PROC 2019 12 INT C I, P1, DOI 10.1109/CISP-BMEI48845.2019.8965823
[10]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171