Application of Convolutional Neural Networks to Emotion Recognition for Robotic Arm Manipulation

被引：0
作者：
Fuertes, Walter [1 ]
Hunter, Karen [1 ]
Benitez, Diego S. [1 ]
Perez, Noel [1 ]
Grijalva, Felipe [1 ]
Baldeon-Calisto, Maria [2 ]
机构：
[1] Univ San Francisco Quito USFQ, Colegio Ciencias & Ingn El Politecn, Quito 170157, Ecuador
[2] Univ San Francisco Quito USFQ, Ingn Ind, CATENA SFQ, Quito 170157, Ecuador
来源：
2023 IEEE COLOMBIAN CONFERENCE ON APPLICATIONS OF COMPUTATIONAL INTELLIGENCE, COLCACI | 2023年
关键词：
emotion recognition; convolution neural networks; robotic arm control; EYES;
D O I：
10.1109/COLCACI59285.2023.10225880
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents the development of a system that operates a robotic arm to deliver an object based on the facial expression of a human standing in front of the robot, demonstrating real-time emotion recognition for physical Human-Robot Interaction. To achieve this, a convolutional neural network-based model was developed to identify emotions in real time. The robotic arm operation was implemented using an embedded NVidia Jetson Nano computer, a web camera, and OpenCV, ROS, and TensorFlow libraries. Using a 26.6k face photos data set from the emotion detection database, the built emotion detection model demonstrated an accuracy of 93.5% and an error of 6.5% during training and validation. The final real-time prototype had a testing accuracy of 94% with an error of 6%. This proof-of-concept shows that in the near future more advanced applications that harness user emotions may also be built.
引用
收藏
页数：6
相关论文
共 50 条
  • [31] Emotion recognition using heterogeneous convolutional neural networks combined with multimodal factorized bilinear pooling
    Zhang, Yong
    Cheng, Cheng
    Wang, Shuai
    Xia, Tianqi
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 77
  • [32] Emotion recognition in speech using neural networks
    Nicholson, J
    Takahashi, K
    Nakatsu, R
    NEURAL COMPUTING & APPLICATIONS, 2000, 9 (04) : 290 - 296
  • [33] Facial Emotion Recognition on a Dataset Using Convolutional Neural Network
    Tumen, Vedat
    Soylemez, Omer Faruk
    Ergen, Burhan
    2017 INTERNATIONAL ARTIFICIAL INTELLIGENCE AND DATA PROCESSING SYMPOSIUM (IDAP), 2017,
  • [34] Recurrent Neural Networks for Emotion Recognition in Video
    Kahou, Samira Ebrahimi
    Michalski, Vincent
    Konda, Kishore
    Memisevic, Roland
    Pal, Christopher
    ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, : 467 - 474
  • [35] Facial Emotion Recognition of Students using Convolutional Neural Network
    Lasri, Imane
    Solh, Anouar Riad
    El Belkacemi, Mourad
    2019 THIRD INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS 2019), 2019,
  • [36] An improved graph convolutional neural network for EEG emotion recognition
    Xu, Bingyue
    Zhang, Xin
    Zhang, Xiu
    Sun, Baiwei
    Wang, Yujie
    Neural Computing and Applications, 2024, 36 (36) : 23049 - 23060
  • [37] Multimodal Emotion Recognition Based on Ensemble Convolutional Neural Network
    Huang, Haiping
    Hu, Zhenchao
    Wang, Wenming
    Wu, Min
    IEEE ACCESS, 2020, 8 : 3265 - 3271
  • [38] Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks
    Chen, J. X.
    Zhang, P. W.
    Mao, Z. J.
    Huang, Y. F.
    Jiang, D. M.
    Zhang, Andy N.
    IEEE ACCESS, 2019, 7 : 44317 - 44328
  • [39] CCNN-SVM: Automated Model for Emotion Recognition Based on Custom Convolutional Neural Networks with SVM
    Rashad, Metwally
    Alebiary, Doaa M.
    Aldawsari, Mohammed
    El-Sawy, Ahmed A.
    AbuEl-Atta, Ahmed H.
    INFORMATION, 2024, 15 (07)
  • [40] Multimodal Emotion Recognition via Convolutional Neural Networks: Comparison of different strategies on two multimodal datasets
    Bilotti, U.
    Bisogni, C.
    De Marsico, M.
    Tramonte, S.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
12345