Emotional state recognition based on functional near-infrared spectroscopy

被引:0
作者
Jiang J. [1 ]
Jiao X. [1 ]
Pan J. [1 ]
Zhang Z. [1 ]
Cao Y. [1 ]
Xiao Y. [1 ]
机构
[1] National Key Laboratory of Human Factor Engineering, China Astronaut Research and Training Centre, Beijing
来源
Guangxue Xuebao/Acta Optica Sinica | 2016年 / 36卷 / 03期
关键词
Emotional state recognition; Functional near-infrared spectroscopy; Medical optics; Pattern recognition; Support vector machine;
D O I
10.3788/AOS201636.0317002
中图分类号
学科分类号
摘要
In order to investigate the human emotional state recognition, the functional near-infrared spectroscopy (fNIRs) technique is applied to measure hemodynamic signals of 15 participants who are requested to see six types of pictures, and the participants have to complete 7-point rating scale of valence and arousal after every picture stimulus. The support vector machine (SVM) and support vector machine based recursive feature elimination (SVMRFE) algorithm are applied to design classifiers. Under different emotional image stimulus, the hemodynamic signals of some participants show significant neural response. With the target classification based on valence, arousal and emotion category, the accuracy is 81%, 78.78% and 68%, respectively. The 5th and 6th channels for fNIRs measurement are significantly sensitive to arousal and valence state, and the two channels are located at orbitonfrontal cortex and dorsolateral prefrontal cortex regions. Besides, it is found that the entropy of fNIRs can reflect the variation in emotional state effectively. The results suggest that fNIRs can be used for recognition of human emotional state. © 2016, Chinese Laser Press. All right reserved.
引用
收藏
页数:11
相关论文
共 31 条
[11]  
Hoshi Y., Huang J., Kohri S., Et al., Recognition of human emotions from cerebral blood flow changes in the frontal region: A study with event-related near-infrared spectroscopy, Journal of Neuroimaging, 21, 2, pp. 94-101, (2009)
[12]  
Pan J., Jiao X., Jiao D., Et al., Study on variation in cortex oxygen with task features using functional near-infrared spectroscopy, Acta Optica Sinica, 35, 8, (2015)
[13]  
Dieler A.C., Plichta M.M., Sler T., Et al., Suppression of emotional words in the Think/No-Think paradigm investigated with functional near-infrared spectroscopy, International Journal of Psychophysiology, 78, 2, pp. 129-135, (2010)
[14]  
Sourina O., Wang Q., Liu Y., Et al., A real-time fractal-based brain state recognition from EEG and its applications, Proceedings of the International Conference on Bio-Inspired Systems and Signal Processing, pp. 82-90, (2011)
[15]  
Lischke A., Berger C., Prehn K., Et al., Intranasal oxytocin enhances emotion recognition from dynamic facial expressions and leaves eyegaze unaffected, Psychoneuroendocrinology, 37, 4, pp. 475-481, (2012)
[16]  
Khalili Z., Moradi M.H., Emotion recognition system using brain and peripheral signals: Using correlation dimension to improve the results of EEG, IEEE International Joint Conference on Neural Networks, pp. 1571-1575, (2009)
[17]  
Hoshi Y., Huang J., Kohri S., Et al., Recognition of human emotions from cerebral blood flow changes in the frontal region: A study with event-related near-infrared spectroscopy, Journal of Neuroimaging, 21, 2, pp. 94-101, (2009)
[18]  
Liu Y., Sourina O., Nguyen M.K., Real-time EEG-based emotion recognition and its applications, Transactions on Computational Science XII, 6670, pp. 256-277, (2011)
[19]  
Lang P.J., Bradley M.M., Cuthbert B.N., International affective picture system (IAPS): Affective ratings of pictures and instruction manual, Technical Report A-8, (2008)
[20]  
Bradley M.M., Lang P.J., Measuring emotion: The self-assessment manikin and the semantic differential, Journal of Behavior Therapy & Experimental Psychiatry, 25, 1, pp. 49-59, (1994)