Interaction Process Label Recognition in Group Discussion

被引:1
作者
Li, Sixia [1 ]
Okada, Shogo [2 ]
Dang, Jianwu [1 ]
机构
[1] Japan Adv Inst Sci & Technol, Nomi, Ishikawa, Japan
[2] RIKEN AIP, Japan Adv Inst Sci & Technol, Nomi, Ishikawa, Japan
来源
ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2019年
关键词
Interaction Process Analysis; Multimodal; Group Analysis; Machine Learning;
D O I
10.1145/3340555.3353743
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In qualifying and analyzing the performance of group interaction, interaction processing analysis (IPA) defined by Bale is considered a useful approach. IPA is a system for labeling a total of 12 interaction categories for the interaction process. Automatic IPA can manually encompass the gap in spending manpower and can efficiently qualify group performance. In this paper, we present computational interaction processing analysis by developing a model to recognize categories of IPA. We extract both verbal features and nonverbal features for IPA category recognition modeling with SVM, RF, DNN and LSTM machine learning algorithms and analyze the contribution of multimodal features and unimodal features for the total data and each label. We also investigate the effect of context information by training sequences with different lengths with an LSTM and evaluating them. The results show that multimodal features achieve the best performance with an F1 score of 0.601 for the recognition of 12 IPA categories using the total data. Multimodal features are better than the unimodal features for the total data and most labels. The results of investigating context information show that a suitable length of sequence enables a longer sequence to achieve the best Fl score of 0.602 and a better performance for recognition.
引用
收藏
页码:426 / 434
页数:9
相关论文
共 30 条
[1]  
[Anonymous], 2018, P GROUP INT FRONT TE
[2]  
[Anonymous], P GROUP INT FRONT T
[3]  
[Anonymous], 2016, P IEEE WINT C APPL C
[4]  
[Anonymous], 2010, INT C MULT INT WORKS
[5]  
[Anonymous], 2006, MECAB YET ANOTHER PA
[6]  
[Anonymous], P GROUP INT FRONT TE
[7]  
[Anonymous], 2014, P ACM ICMI
[8]  
[Anonymous], P GROUP INT FRONT TE
[9]  
[Anonymous], 1950, AM SOCIOL REV
[10]  
[Anonymous], 2009, 10 ANN C INT SPEECH