Automatic detection and classification of emotional states in virtual reality and standard environments (LCD): comparing valence and arousal of induced emotions

被引:19
作者
Magdin, Martin [1 ]
Balogh, Zoltan [1 ]
Reichel, Jaroslav [1 ]
Francisti, Jan [1 ]
Koprda, Stefan [1 ]
Gyorgy, Molnar [2 ]
机构
[1] Constantine Philosopher Univ Nitra, Fac Nat Sci, Dept Informat, Tr A Hlinku 1, Nitra 94974, Slovakia
[2] Budapest Univ Technol & Econ, Dept Tech Educ, Budapest, Hungary
关键词
Virtual reality (VR); Emotions; Classification; Valence; Arousal; IDENTIFICATION; SYSTEM;
D O I
10.1007/s10055-021-00506-5
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The following case study was carried out on a sample of one experimental and one control group. The participants of the experimental group watched the movie section from the standardized LATEMO-E database via virtual reality (VR) on Oculus Rift S and HTC Vive Pro devices. In the control group, the movie section was displayed on the LCD monitor. The movie section was categorized according to Ekman's and Russell's classification model of evoking an emotional state. The range of valence and arousal was determined in both observed groups. Valence and arousal were measured in each group using a Self-Assessment Manikin (SAM). The control group was captured by a camera and evaluated by Affdex software from Affectiva in order to compare valence values. The control group showed a very high correlation (0.92) between SAM and Affdex results. Having considered the Affdex results as a reference value, it can be concluded that SAM participants evaluated their emotions objectively. The results from both groups show that the movie section is supposed to evoke negative emotion. Negative emotion was perceived more intensely than its counterpart, positive emotion. Using virtual reality to evoke negative emotion (anger) has confirmed that VR triggers a significantly stronger intensity of emotion than LCD.
引用
收藏
页码:1029 / 1041
页数:13
相关论文
共 65 条
  • [1] Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review
    Alberdi, Ane
    Aztiria, Asier
    Basarab, Adrian
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2016, 59 : 49 - 75
  • [2] Learning in virtual reality: Effects on performance, emotion and engagement
    Allcoat, Devon
    von Muehlenen, Adrian
    [J]. RESEARCH IN LEARNING TECHNOLOGY, 2018, 26
  • [3] [Anonymous], 2006, P C HUM FACT COMP SY, DOI [DOI 10.1145/1125451.1125653, 10.1145/1125451.1125653]
  • [4] Baby Shalini T., 2013, INT J ENG TRENDS TEC, V4, P1337
  • [5] Towards multimodal emotion recognition in e-learning environments
    Bahreini, Kiavash
    Nadolski, Rob
    Westera, Wim
    [J]. INTERACTIVE LEARNING ENVIRONMENTS, 2016, 24 (03) : 590 - 605
  • [6] MEASURING EMOTION - THE SELF-ASSESSMENT MANNEQUIN AND THE SEMANTIC DIFFERENTIAL
    BRADLEY, MM
    LANG, PJ
    [J]. JOURNAL OF BEHAVIOR THERAPY AND EXPERIMENTAL PSYCHIATRY, 1994, 25 (01) : 49 - 59
  • [7] Integration of the peer assessment approach with a virtual reality design system for learning earth science
    Chang, Shao-Chen
    Hsu, Ting-Chia
    Jong, Morris Siu-Yung
    [J]. COMPUTERS & EDUCATION, 2020, 146
  • [8] 20 years of research on virtual reality and augmented reality in tourism context: A text-mining approach
    Correia Loureiro, Sandra Maria
    Guerreiro, Joao
    Ali, Faizan
    [J]. TOURISM MANAGEMENT, 2020, 77
  • [9] Understanding the use of Virtual Reality in Marketing: A text mining-based review
    Correia Loureiro, Sandra Maria
    Guerreiro, Joao
    Eloy, Sara
    Langaro, Daniela
    Panchapakesan, Padma
    [J]. JOURNAL OF BUSINESS RESEARCH, 2019, 100 : 514 - 530
  • [10] Human emotions detection based on a smart-thermal system of thermographic images
    Cruz-Albarran, Irving A.
    Benitez-Rangel, Juan P.
    Osornio-Rios, Roque A.
    Morales-Hernandez, Luis A.
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2017, 81 : 250 - 261