How symbolic gestures and words interact with each other

被引:29
作者
Barbieri, Filippo [1 ]
Buonocore, Antimo [1 ]
Volta, Riccardo Dalla [1 ]
Gentilucci, Maurizio [1 ]
机构
[1] Univ Parma, Dipartimento Neurosci, I-43100 Parma, Italy
关键词
Symbolic gestures; Words; Voice spectra; Arm kinematics; Broca's area; GRASP REPRESENTATIONS; SPEECH; COMMUNICATION; DISCRIMINATION; LOCALIZATION; INTEGRATION; EXECUTION; CHILDREN; ANATOMY; IMAGERY;
D O I
10.1016/j.bandl.2009.01.002
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Previous repetitive Transcranial Magnetic Stimulation and neuroimaging studies showed that Broca's area is involved in the interaction between gestures and words. However, in these studies the nature of this interaction was not fully investigated; consequently, we addressed this issue in three behavioral experiments. When compared to the expression of one signal at a time. arm kinematics slowed down and voice parameters were amplified when congruent words plus gestures were simultaneously produced (experiment 1). When word and gesture were incongruent, arm kinematics did not change regardless of word category, whereas the gesture induced variation in vocal parameters of communicative and action words only (experiments 2 and 3). Data are discussed according to the hypothesis that integration between gesture and word occurs by transferring the social intention to interact directly with the interlocutor from the gesture to the word. (C) 2009 Elsevier Inc. All rights reserved.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 46 条
  • [1] Speech and gesture share the same communication system
    Bernardis, P
    Gentilucci, M
    [J]. NEUROPSYCHOLOGIA, 2006, 44 (02) : 178 - 190
  • [2] A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study
    Binkofski, F
    Buccino, G
    Posse, S
    Seitz, RJ
    Rizzolatti, G
    Freund, HJ
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 1999, 11 (09) : 3276 - 3286
  • [3] Binkofski F, 2000, HUM BRAIN MAPP, V11, P273, DOI 10.1002/1097-0193(200012)11:4<273::AID-HBM40>3.0.CO
  • [4] 2-0
  • [5] NEURAL CORRELATES OF MENTAL TRANSFORMATIONS OF THE BODY-IN-SPACE
    BONDA, E
    PETRIDES, M
    FREY, S
    EVANS, A
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1995, 92 (24) : 11180 - 11184
  • [6] Neural circuits involved in the recognition of actions performed by nonconspecifics: An fMRI study
    Buccino, G
    Lui, F
    Canessa, N
    Patteri, I
    Lagravinese, G
    Benuzzi, F
    Porro, CA
    Rizzolatti, G
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2004, 16 (01) : 114 - 126
  • [7] Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study
    Buccino, G
    Binkofski, F
    Fink, GR
    Fadiga, L
    Fogassi, L
    Gallese, V
    Seitz, RJ
    Zilles, K
    Rizzolatti, G
    Freund, HJ
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 2001, 13 (02) : 400 - 404
  • [8] COMMUNICATIVE FUNCTIONS OF HAND ILLUSTRATORS
    COHEN, AA
    [J]. JOURNAL OF COMMUNICATION, 1977, 27 (04) : 54 - 63
  • [9] MAPPING MOTOR REPRESENTATIONS WITH POSITRON EMISSION TOMOGRAPHY
    DECETY, J
    PERANI, D
    JEANNEROD, M
    BETTINARDI, V
    TADARY, B
    WOODS, R
    MAZZIOTTA, JC
    FAZIO, F
    [J]. NATURE, 1994, 371 (6498) : 600 - 602
  • [10] THE ANATOMY OF PHONOLOGICAL AND SEMANTIC PROCESSING IN NORMAL SUBJECTS
    DEMONET, JF
    CHOLLET, F
    RAMSAY, S
    CARDEBAT, D
    NESPOULOUS, JL
    WISE, R
    RASCOL, A
    FRACKOWIAK, R
    [J]. BRAIN, 1992, 115 : 1753 - 1768