A Research on Emotion Recognition of the Elderly Based on Transformer and Physiological Signals

被引:3
作者
Feng, Guohong [1 ]
Wang, Hongen [1 ]
Wang, Mengdi [1 ]
Zheng, Xiao [1 ]
Zhang, Runze [1 ]
机构
[1] Northeast Forestry Univ, Coll Mech & Elect Engn, Harbin 150040, Peoples R China
关键词
elderly; emotion recognition; recursive map; vision transformer; deep learning;
D O I
10.3390/electronics13153019
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at problems such as the difficulty of recognizing emotions in the elderly and the inability of traditional machine-learning models to effectively capture the nonlinear relationship between physiological signal data, a Recursive Map (RM) combined with a Vision Transformer (ViT) is proposed to recognize the emotions of the elderly based on Electroencephalogram (EEG), Electrodermal Activity (EDA), and Heart Rate Variability (HRV) signals. The Dung Beetle Optimizer (DBO) is used to optimize the variational modal decomposition of EEG, EDA, and HRV signals. The optimized decomposed time series signals are converted into two-dimensional images using RM, and then the converted image signals are applied to the ViT for the study of emotion recognition of the elderly. The pre-trained weights of ViT on the ImageNet-22k dataset are loaded into the model and retrained with the two-dimensional image data. The model is validated and compared using the test set. The research results show that the recognition accuracy of the proposed method on EEG, EDA, and HRV signals is 99.35%, 86.96%, and 97.20%, respectively. This indicates that EEG signals can better reflect the emotional problems of the elderly, followed by HRV signals, while EDA signals have poorer effects. Compared with Support Vector Machine (SVM), Naive Bayes (NB), and K-Nearest Neighbors (KNN), the recognition accuracy of the proposed method is increased by at least 9.4%, 11.13%, and 12.61%, respectively. Compared with ResNet34, EfficientNet-B0, and VGG16, it is increased by at least 1.14%, 0.54%, and 3.34%, respectively. This proves the superiority of the proposed method in emotion recognition for the elderly.
引用
收藏
页数:21
相关论文
共 21 条
[1]   Quality of life improvement: smart approaches for the working and aging populations [J].
Barakovic, Sabina ;
Akhtar, Zahid ;
Husic, Jasmina Barakovic .
FRONTIERS IN PUBLIC HEALTH, 2024, 12
[2]   A hybrid method for muscle artifact removal from EEG signals [J].
Chen, Qiang ;
Li, Yingying ;
Yuan, Xiaohui .
JOURNAL OF NEUROSCIENCE METHODS, 2021, 353
[3]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[4]   Emotion Recognition Correlates With Social-Neuropsychiatric Dysfunction in Huntington's Disease [J].
Kempnich, Clare L. ;
Andrews, Sophie C. ;
Fisher, Fiona ;
Wong, Dana ;
Georgiou-Karistianis, Nellie ;
Stout, Julie C. .
JOURNAL OF THE INTERNATIONAL NEUROPSYCHOLOGICAL SOCIETY, 2018, 24 (05) :417-423
[5]   Survey of Transformer-Based Object Detection Algorithms [J].
Li, Jian ;
Du, Jianqiang ;
Zhu, Yanchen ;
Guo, Yongkun .
Computer Engineering and Applications, 2023, 59 (10) :48-64
[6]  
[李艳 Li Yan], 2022, [计算机应用研究, Application Research of Computers], V39, P1132
[7]  
Li Z., 2023, Sci. Technol. Eng, V23, P2044, DOI [10.12404/j.issn.1671-1815.2023.23.05.02044, DOI 10.12404/J.ISSN.1671-1815.2023.23.05.02044]
[8]  
Liu Y.F., 2023, J. Metrol, V44, P1147
[9]   Universal adversarial perturbations for CNN classifiers in EEG-based BCIs [J].
Liu, Zihan ;
Meng, Lubin ;
Zhang, Xiao ;
Fang, Weili ;
Wu, Dongrui .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
[10]  
[楼哲航 Lou Zhehang], 2022, [红外技术, Infrared Technology], V44, P1167