What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay?

被引:104
|
作者
Gao, Yuan [1 ]
Bianchi-Berthouze, Nadia [2 ]
Meng, Hongying [3 ]
机构
[1] UCL, Dept Comp Sci, London WC1E 6BT, England
[2] UCL, UCLIC, London WC1E 6BT, England
[3] Brunel Univ, Sch Engn & Design, London, England
关键词
Automatic emotion recognition; touch-based computer games; touch behavior; affective touch; ELECTRONIC DIARIES; AFFECT RECOGNITION; BODY MOVEMENT; GESTURE; COMMUNICATION; PERCEPTION; EXPRESSION; MODEL;
D O I
10.1145/2395131.2395138
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing number of people playing games on touch-screen mobile phones raises the question of whether touch behaviors reflect players' emotional states. This prospect would not only be a valuable evaluation indicator for game designers, but also for real-time personalization of the game experience. Psychology studies on acted touch behavior show the existence of discriminative affective profiles. In this article, finger-stroke features during gameplay on an iPod were extracted and their discriminative power analyzed. Machine learning algorithms were used to build systems for automatically discriminating between four emotional states (Excited, Relaxed, Frustrated, Bored), two levels of arousal and two levels of valence. Accuracy reached between 69% and 77% for the four emotional states, and higher results (similar to 89%) were obtained for discriminating between two levels of arousal and two levels of valence. We conclude by discussing the factors relevant to the generalization of the results to applications other than games.
引用
收藏
页数:30
相关论文
共 50 条
  • [31] What Can Self-Reports and Acoustic Data Analyses on Emotions Tell Us?
    Soleimani, Samaneh
    Law, Effie Lai-Chong
    DIS'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON DESIGNING INTERACTIVE SYSTEMS, 2017, : 489 - 501
  • [32] What gas exchange data can tell us about photosynthesis
    Sharkey, Thomas D.
    PLANT CELL AND ENVIRONMENT, 2016, 39 (06) : 1161 - 1163
  • [33] Segmentation in behavior and what it can tell us about brain function
    Schleidt, M
    Kien, J
    HUMAN NATURE-AN INTERDISCIPLINARY BIOSOCIAL PERSPECTIVE, 1997, 8 (01): : 77 - 111
  • [34] What can mathematical modeling tell us about hybrid invasions?
    Hall, Richard J.
    Ayres, Debra R.
    BIOLOGICAL INVASIONS, 2009, 11 (05) : 1217 - 1224
  • [35] Segmentation in behavior and what it can tell us about brain function
    Margret Schleidt
    Jenny Kien
    Human Nature, 1997, 8 : 77 - 111
  • [36] What Emotion Facial Expressions Tell Us About the Health of Others
    Hareli, Shlomo
    David, Or
    Hess, Ursula
    FRONTIERS IN PSYCHOLOGY, 2020, 11
  • [37] What could cognitive neuroscience tell us about recognition memory?
    Kalish, Michael L.
    Dunn, John C.
    AUSTRALIAN JOURNAL OF PSYCHOLOGY, 2012, 64 (01) : 29 - 36
  • [38] What artifice can and cannot tell us about animal behavior
    Powell, Daniel L.
    Rosenthal, Gil G.
    CURRENT ZOOLOGY, 2017, 63 (01) : 21 - 26
  • [39] N* Experiments and what they tell us about Strong QCD Physics
    Burkert, V. D.
    12TH INTERNATIONAL WORKSHOP ON THE PHYSICS OF EXCITED NUCLEONS (NSTAR 2019), 2020, 241
  • [40] What can individual differences tell us about the specialization of function?
    Rabaglia, Cristina D.
    Marcus, Gary F.
    Lane, Sean P.
    COGNITIVE NEUROPSYCHOLOGY, 2011, 28 (3-4) : 288 - 303