Predicting Behavior in Cancer-Afflicted Patient and Spouse Interactions using Speech and Language

被引:6
作者
Chakravarthula, Sandeep Nallan [1 ]
Li, Haoqi [1 ]
Tseng, Shao-Yen [1 ]
Reblin, Maija [2 ]
Georgiou, Panayiotis [1 ]
机构
[1] Univ Southern Calif, Dept Elect & Comp Engn, Los Angeles, CA 90007 USA
[2] H Lee Moffitt Canc Ctr & Res Inst, Dept Hlth Outcomes & Behav, Tampa, FL USA
来源
INTERSPEECH 2019 | 2019年
关键词
cancer; behavior; dyadic interaction; multimodal; deep learning; RISK-ASSESSMENT; COMMUNICATION;
D O I
10.21437/Interspeech.2019-1888
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Cancer impacts the quality of life of those diagnosed as well as their spouse caregivers, in addition to potentially influencing their day-to-day behaviors. There is evidence that effective communication between spouses can improve well-being related to cancer but it is difficult to efficiently evaluate the quality of daily life interactions using manual annotation frameworks. Automated recognition of behaviors based on the interaction cues of speakers can help analyze interactions in such couples and identify behaviors which are beneficial for effective communication. In this paper, we present and detail a dataset of dyadic interactions in 85 real-life cancer-afflicted couples and a set of observational behavior codes pertaining to interpersonal communication attributes. We describe and employ neural network-based systems for classifying these behaviors based on turn-level acoustic and lexical speech patterns. Furthermore, we investigate the effect of controlling for factors such as gender, patient/caregiver role and conversation content on behavior classification. Analysis of our preliminary results indicates the challenges in this task due to the nature of the targeted behaviors and suggests that techniques incorporating contextual processing might be better suited to tackle this problem.
引用
收藏
页码:3073 / 3077
页数:5
相关论文
共 32 条
[1]   Action and Emotion Recognition from Point Light Displays: An Investigation of Gender Differences [J].
Alaerts, Kaat ;
Nackaerts, Evelien ;
Meyns, Pieter ;
Swinnen, Stephan P. ;
Wenderoth, Nicole .
PLOS ONE, 2011, 6 (06)
[2]  
American Cancer Society, 2019, Cancer Treatment Survivorship Facts Figures 2019-2021, DOI DOI 10.1080/15398285.2012.701177
[3]  
[Anonymous], 2018, ARXIV180706792
[4]  
[Anonymous], GENTLE FORCED ALIGNE
[5]   New frontiers in couple-based interventions in cancer care: refining the prescription for spousal communication [J].
Badr, Hoda .
ACTA ONCOLOGICA, 2017, 56 (02) :139-145
[6]   The Promise and the Challenge of Technology-Facilitated Methods for Assessing Behavioral and Cognitive Markers of Risk for Suicide among US Army National Guard Personnel [J].
Baucom, Brian R. W. ;
Georgiou, Panayiotis ;
Bryan, Craig J. ;
Garland, Eric L. ;
Leifker, Feea ;
May, Alexis ;
Wong, Alexander ;
Narayanan, Shrikanth S. .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2017, 14 (04)
[7]   Toward automating a human behavioral coding system for married couples' interactions using speech acoustic features [J].
Black, Matthew P. ;
Katsamanis, Athanasios ;
Baucom, Brian R. ;
Lee, Chi-Chun ;
Lammert, Adam C. ;
Christensen, Andrew ;
Georgiou, Panayiotis G. ;
Narayanan, Shrikanth S. .
SPEECH COMMUNICATION, 2013, 55 (01) :1-21
[8]  
Black MP, 2011, INTERSPEECH 2011, V4
[9]  
Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
[10]   A review of depression and suicide risk assessment using speech analysis [J].
Cummins, Nicholas ;
Scherer, Stefan ;
Krajewski, Jarek ;
Schnieder, Sebastian ;
Epps, Julien ;
Quatieri, Thomas F. .
SPEECH COMMUNICATION, 2015, 71 :10-49