Wearables and Social Signal Processing for Smarter Public Presentations

被引:9
作者
Mihoub, Alaeddine [1 ]
Lefebvre, Gregoire [1 ]
机构
[1] Orange Labs, 28 Chemin Vieux Chene, F-38240 Meylan, France
关键词
Oral presentation; Social intelligence; wearable devices; multimodal behavior assessment; dynamic bayesian network;
D O I
10.1145/3234507
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Social Signal Processing techniques have given the opportunity to analyze in-depth human behavior in social face-to-face interactions. With recent advancements, it is henceforth possible to use these techniques to augment social interactions, especially human behavior in oral presentations. The goal of this study is to train a computational model able to provide a relevant feedback to a public speaker concerning his/her coverbal communication. Hence, the role of this model is to augment the social intelligence of the orator and then the relevance of his/her presentation. To this end, we present an original interaction setting in which the speaker is equipped with only wearable devices. Several coverbal modalities have been extracted and automatically annotated namely speech volume, intonation, speech rate, eye gaze, hand gestures, and body movements. In this article, which is an extension of our previous article published in IUI'17, we compare our Dynamic Bayesian Network design to classical J48/Multi-Layer Perceptron/Support Vector Machine classifiers, propose a subjective evaluation of presenter skills with a discussion in regards to our automatic evaluation, and we add a complementary study about using DBScan versus k-means algorithm in the design process of our Dynamic Bayesian Network.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] Albrecht K., 2006, Social Intelligence: The New Science of Success
  • [2] [Anonymous], 2009, ACM SIGKDD explorations newsletter, DOI 10.1145/1656274.1656278
  • [3] [Anonymous], 2006, Probabilistic Networks and Expert Systems: Exact Computational Methods for Bayesian Networks
  • [4] [Anonymous], 1966, Soviet Physics Doklady
  • [5] [Anonymous], 1970, KINESICS CONTEXT ESS
  • [6] [Anonymous], SPEECH PROS 3 INT C
  • [7] [Anonymous], 2014, P ACM ICMI
  • [8] [Anonymous], 2011, GEST YOUR BOD SPEAKS
  • [9] Argyle M., 1975, BODILY COMMUNICATION
  • [10] Boersma P., 2001, GLOT INT, V5, P341