Application of Convolutional Neural Networks to Emotion Recognition for Robotic Arm Manipulation

被引：0

作者：

Fuertes, Walter ^{[1
]}

Hunter, Karen ^{[1
]}

Benitez, Diego S. ^{[1
]}

Perez, Noel ^{[1
]}

Grijalva, Felipe ^{[1
]}

Baldeon-Calisto, Maria ^{[2
]}

机构：

[1] Univ San Francisco Quito USFQ, Colegio Ciencias & Ingn El Politecn, Quito 170157, Ecuador

[2] Univ San Francisco Quito USFQ, Ingn Ind, CATENA SFQ, Quito 170157, Ecuador

来源：

2023 IEEE COLOMBIAN CONFERENCE ON APPLICATIONS OF COMPUTATIONAL INTELLIGENCE, COLCACI | 2023年

关键词：

emotion recognition; convolution neural networks; robotic arm control; EYES;

D O I：

10.1109/COLCACI59285.2023.10225880

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper presents the development of a system that operates a robotic arm to deliver an object based on the facial expression of a human standing in front of the robot, demonstrating real-time emotion recognition for physical Human-Robot Interaction. To achieve this, a convolutional neural network-based model was developed to identify emotions in real time. The robotic arm operation was implemented using an embedded NVidia Jetson Nano computer, a web camera, and OpenCV, ROS, and TensorFlow libraries. Using a 26.6k face photos data set from the emotion detection database, the built emotion detection model demonstrated an accuracy of 93.5% and an error of 6.5% during training and validation. The final real-time prototype had a testing accuracy of 94% with an error of 6%. This proof-of-concept shows that in the near future more advanced applications that harness user emotions may also be built.

引用

页数：6

共 50 条

[1] Emotion Recognition in Horses with Convolutional Neural Networks
Corujo, Luis A.
Kieson, Emily
Schloesser, Timo
Gloor, Peter A.
FUTURE INTERNET, 2021, 13 (10):
[2] Facial Emotion Recognition using Convolutional Neural Networks
Rzayeva, Zeynab
Alasgarov, Emin
2019 IEEE 13TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2019), 2019, : 91 - 95
[3] Emotion recognition by assisted learning with convolutional neural networks
He, Xuanyu
Zhang, Wei
NEUROCOMPUTING, 2018, 291 : 187 - 194
[4] EEG Based Emotion Recognition with Convolutional Neural Networks
Ozcan, Caner
Cizmeci, Hnseyin
2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
[5] Continuous Emotion Recognition with Spatiotemporal Convolutional Neural Networks
Teixeira, Thomas
Granger, Eric
Lameiras Koerich, Alessandro
APPLIED SCIENCES-BASEL, 2021, 11 (24):
[6] Facial Emotion Recognition using Convolutional Neural Networks
Gopichand, G.
Reddy, I. Ravi Prakash
Santhi, H.
Akula, Vijaya Krishna
IMPENDING INQUISITIONS IN HUMANITIES AND SCIENCES, ICIIHS-2022, 2024, : 198 - 203
[7] Continuous Speech Emotion Recognition with Convolutional Neural Networks
Vryzas, Nikolaos
Vrysis, Lazaros
Matsiola, Maria
Kotsakis, Rigas
Dimoulas, Charalampos
Kalliris, George
JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2020, 68 (1-2): : 14 - 24
[8] Continuous speech emotion recognition with convolutional neural networks
Vryzas, Nikolaos
Vrysis, Lazaros
Matsiola, Maria
Kotsakis, Rigas
Dimoulas, Charalampos
Kalliris, George
AES: Journal of the Audio Engineering Society, 2020, 68 (1-2): : 14 - 24
[9] Speech emotion recognition with deep convolutional neural networks
Issa, Dias
Demirci, M. Fatih
Yazici, Adnan
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 59
[10] Multiple Convolutional Neural Networks in EEG Emotion Recognition
Khairunissa, Hana Dwi
Djamal, Esmeralda Contessa
Wulandari, Arlisa
2021 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATICS ENGINEERING (IC2IE 2021), 2021, : 30 - 35

← 1 2 3 4 5 →