"Emotions are the Great Captains of Our Lives": Measuring Moods Through the Power of Physiological and Environmental Sensing

被引:2
作者
Arano, Keith April [1 ]
Gloor, Peter [2 ]
Orsenigo, Carlotta [1 ]
Vercellis, Carlo [1 ]
机构
[1] Politecn Milan, Dept Management Econ & Ind Engn, I-20156 Milan, Italy
[2] MIT, Ctr Collect Intelligence, 77 Massachusetts Ave, Cambridge, MA 02139 USA
关键词
Mood; Machine learning; Physiology; Intelligent sensors; Wearable sensors; Education; affective computing; modelling human emotion; affect sensing and analysis; ACHIEVEMENT; CLASSROOM; BODY;
D O I
10.1109/TAFFC.2020.3003736
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The article proposes the use of a smartwatch-based system for measuring the emotions of individuals in a classroom setting with respect to five mood variables: Activation, Tiredness, Pleasance, Quality of Presentation and Understanding. Internal (body) and external (environment) data such as movement, heart rate, noise, temperature and humidity were collected through the built-in sensors of the smartwatch. The system was verified by means of a longitudinal study that has been carried out in a series of workshops and lectures. Through experience-based sampling, participants were polled at periodic time intervals asking them to enter a self-assessment of the aforementioned mood states directly on the smartwatch. The goal was to demonstrate whether sensor data can be used to effectively predict the five moods. By resorting to a machine learning approach our system was able to predict the moods with an accuracy ranging between 89-95 percent for single-output classification, 92-99 percent for the chain classification task and of approximately 93 percent for the multi-output analysis. Our results showed also that body signals are better predictors compared to the external environmental variables. These results demonstrate and verify the potential of smartwatches in collecting and predicting human emotions, enabling dynamic feedback loops to enhance user experience.
引用
收藏
页码:1378 / 1389
页数:12
相关论文
共 46 条
  • [1] Adibuzzaman M., 2013, Proceedings of the 2013 Research in Adaptive and Convergent Systems, P454
  • [2] [Anonymous], 2014, MEASURING STUDENT LE
  • [3] Aouedi Ons, 2020, Hybrid Intelligent Systems. 18th International Conference on Hybrid Intelligent Systems (HIS 2018). Advances in Intelligent Systems and Computing (AISC 923), P96, DOI 10.1007/978-3-030-14347-3_10
  • [4] Barata G., 2015, Smart Learning Environments, V2, P1, DOI DOI 10.1186/S40561-015-0017-8
  • [5] LIRIS-ACCEDE: A Video Database for Affective Content Analysis
    Baveye, Yoann
    Dellandrea, Emmanuel
    Chamaret, Christel
    Chen, Liming
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (01) : 43 - 55
  • [6] Multi-Modal Audio, Video and Physiological Sensor Learning for Continuous Emotion Prediction
    Brady, Kevin
    Gwon, Youngjune
    Khorrami, Pooya
    Godoy, Elizabeth
    Campbell, William
    Dagli, Charlie
    Huang, Thomas S.
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL WORKSHOP ON AUDIO/VISUAL EMOTION CHALLENGE (AVEC'16), 2016, : 97 - 104
  • [7] Budner P, 2017, Arxiv, DOI arXiv:1711.06134
  • [8] Bughin J., 2017, ARTIF INTELL
  • [9] What is emotion?
    Cabanac, M
    [J]. BEHAVIOURAL PROCESSES, 2002, 60 (02) : 69 - 83
  • [10] Chollet F., 2015, Keras