Classifying human emotions in HRI: applying global optimization model to EEG brain signals

被引:3
作者
Staffa, Mariacarla [1 ]
D'Errico, Lorenzo [2 ]
Sansalone, Simone [3 ]
Alimardani, Maryam [4 ]
机构
[1] Univ Naples Parthenope, Dept Sci & Technol, Naples, Italy
[2] Univ Naples Federico II, Dept Elect Engn & Informat Technol, Naples, Italy
[3] Univ Naples Federico II, Dept Phys, Naples, Italy
[4] Tilburg Univ, Dept Cognit Sci & Artificial Intelligence, Tilburg, Netherlands
关键词
human-robot interaction (HRI); EEG signals; brain-computer interface (BCI); frontal brain asymmetry (FBA); Theory of Mind (ToM); Global Optimization Model (GOM); machine learning; deep learning; RECOGNITION; ASYMMETRY; STRESS;
D O I
10.3389/fnbot.2023.1191127
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Significant efforts have been made in the past decade to humanize both the form and function of social robots to increase their acceptance among humans. To this end, social robots have recently been combined with brain-computer interface (BCI) systems in an attempt to give them an understanding of human mental states, particularly emotions. However, emotion recognition using BCIs poses several challenges, such as subjectivity of emotions, contextual dependency, and a lack of reliable neuro-metrics for real-time processing of emotions. Furthermore, the use of BCI systems introduces its own set of limitations, such as the bias-variance trade-off, dimensionality, and noise in the input data space. In this study, we sought to address some of these challenges by detecting human emotional states from EEG brain activity during human-robot interaction (HRI). EEG signals were collected from 10 participants who interacted with a Pepper robot that demonstrated either a positive or negative personality. Using emotion valence and arousal measures derived from frontal brain asymmetry (FBA), several machine learning models were trained to classify human's mental states in response to the robot personality. To improve classification accuracy, all proposed classifiers were subjected to a Global Optimization Model (GOM) based on feature selection and hyperparameter optimization techniques. The results showed that it is possible to classify a user's emotional responses to the robot's behavior from the EEG signals with an accuracy of up to 92%. The outcome of the current study contributes to the first level of the Theory of Mind (ToM) in Human-Robot Interaction, enabling robots to comprehend users' emotional responses and attribute mental states to them. Our work advances the field of social and assistive robotics by paving the way for the development of more empathetic and responsive HRI in the future.
引用
收藏
页数:12
相关论文
共 57 条
  • [1] A systematic survey on multimodal emotion recognition using learning algorithms
    Ahmed, Naveed
    Al Aghbari, Zaher
    Girija, Shini
    [J]. INTELLIGENT SYSTEMS WITH APPLICATIONS, 2023, 17
  • [2] Al-Nafjan A, 2017, INT J ADV COMPUT SC, V8, P419
  • [3] Towards multilevel mental stress assessment using SVM with ECOC: an EEG approach
    Al-shargie, Fares
    Tang, Tong Boon
    Badruddin, Nasreen
    Kiguchi, Masashi
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2018, 56 (01) : 125 - 136
  • [4] Assessment of Engagement and Learning During Child-Robot Interaction Using EEG Signals
    Alimardani, Maryam
    van den Braak, Stephanie
    Jouen, Anne-Lise
    Matsunaka, Reiko
    Hiraki, Kazuo
    [J]. SOCIAL ROBOTICS, ICSR 2021, 2021, 13086 : 671 - 682
  • [5] Alimardani M, 2020, IEEE ROMAN, P683, DOI 10.1109/RO-MAN47096.2020.9223428
  • [6] Passive Brain-Computer Interfaces for Enhanced Human-Robot Interaction
    Alimardani, Maryam
    Hiraki, Kazuo
    [J]. FRONTIERS IN ROBOTICS AND AI, 2020, 7
  • [7] Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators
    Alimardani, Maryam
    Nishio, Shuichi
    Ishiguro, Hiroshi
    [J]. SCIENTIFIC REPORTS, 2013, 3
  • [8] Validation of the Emotiv EPOC® EEG gaming systemfor measuring research quality auditory ERPs
    Badcock, Nicholas A.
    Mousikou, Petroula
    Mahajan, Yatin
    de Lissa, Peter
    Thie, Johnson
    McArthur, Genevieve
    [J]. PEERJ, 2013, 1
  • [9] Theory of Mind in Social Robots: Replication of Five Established Human Tests
    Banks, Jaime
    [J]. INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2020, 12 (02) : 403 - 414
  • [10] Bergstra J., 2011, ADV NEURAL INFORM PR, P2546