Brain activity with reading sentences and emoticons - An fMRI study on verbal and nonverbal communication

被引:0
作者
Yuasa, Masahide [1 ]
Saito, Keiichi [2 ]
Mukawa, Naoki [1 ]
机构
[1] School of Information Environment, Tokyo Denki University, Inzai, Chiba 270-1382
[2] Research Center for Advanced Technologies, Tokyo Denki University, Inzai, Chiba 270-1382
关键词
Emoticon; Face; fMRI; Human computer interaction; Nonverbal communication;
D O I
10.1541/ieejeiss.128.1797
中图分类号
学科分类号
摘要
In this paper, we describe a person's brain activity when he/she sees an emoticon at the end of a sentence. An emoticon consists of some characters that resemble the human face and expresses a sender's emotion. With the help of a computer network, we use e-mail, messenger, avatars and so on, in order to convey what we wish to, to a receiver. Moreover, we send an emotional expression by using an emoticon at the end of a sentence. In this research, we investigate the effect of an emoticon as nonverbal information, using an fMRI study. The experimental results show that the right and left inferior frontal gyrus were activated and we detect a sentence with an emoticon as the verbal and nonverval information. © 2008 The Institute of Electrical Engineers of Japan.
引用
收藏
页码:1797 / 1803+11
相关论文
共 9 条
[1]  
Koda T., Maes P., Agents with Faces: The Effects of Personification of Agents, (1996)
[2]  
McCloud S., Understanding Comics, HarperPerennial, (1993)
[3]  
Yuasa M., Saito K., Mukawa N., Emoticons convey emotions without cognition of faces: An fMRI study, Proceedings of CHI2006, (2006)
[4]  
Embick D., Marantz A., Miyashita Y., O'Neil W., Sakai K.L., A syntactic specialization for Broca's area, Proc. Natl. Acad. Sci., 97, pp. 6150-6154, (2000)
[5]  
Suzuki K., Sakai K.L., An event-related fMRI study of explicit syntactic processing of normal/anomalous sentences in contrast to implicit syntactic processing, Cereb. Cortex, 13, pp. 517-526, (2003)
[6]  
Homae F., Hashimoto R., Nakajima K., Miyashita Y., Sakai K.L., From perception to sentence comprehension: The convergence of auditory and visual information of language in the left inferior frontal cortex, NeuroImage, 16, pp. 883-900, (2002)
[7]  
Kanwisher N., McDermott J., Chun M.M., The fusiform face area: A module in human extrastriate cortex specialized for face perception, The Journal of Neuroscience, 17, 11, pp. 4302-4311, (1997)
[8]  
Tong F., Nakayama K., Moscovitch M., Weinrib O., Kanwisher N., Response properties of the human fusiform face area, Cognitive Neuropsychology, 17, 1, pp. 257-279, (2000)
[9]  
Maddock R.J., Garrett A.S., Buonocore M.H., Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task, Human Brain Mapping, 18, 1, pp. 30-41, (2003)