Between bodily action and conventionalized structure: The neural mechanisms of constructed action in sign language comprehension

被引:1
作者
Hernandez, Doris [1 ,2 ,4 ]
Puupponen, Anna [1 ]
Keranen, Jarkko [1 ]
Ortega, Gerardo [3 ]
Jantunen, Tommi [1 ]
机构
[1] Univ Jyvaskyla, Dept Language & Commun Studies, Sign Language Ctr, Jyvaskyla, Finland
[2] Univ Jyvaskyla, Ctr Interdisciplinary Brain Res CIBR, Dept Psychol, Jyvaskyla, Finland
[3] Univ Birmingham, Dept English Language & Appl Linguist, Birmingham, England
[4] Univ Jyvaskyla, Finnish Sign Language, Dept Language & Commun Studies, A Bldg,Seminaarinkatu 15, Jyvaskyla 40014, Finland
基金
芬兰科学院;
关键词
Sign language; Constructed action; Plain telling; N300; N400; Bimodal bilingualism; Meaning processing; Bottom-up processing; EEG; ERP; ELECTROPHYSIOLOGICAL EVIDENCE; WORD RECOGNITION; SPEECH; GESTURE; COMPONENT; SPOKEN; MEG; REPRESENTATION; INTEGRATION; ACTIVATION;
D O I
10.1016/j.bandl.2024.105413
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Sign languages (SLs) are expressed through different bodily actions, ranging from re-enactment of physical events (constructed action, CA) to sequences of lexical signs with internal structure (plain telling, PT). Despite the prevalence of CA in signed interactions and its significance for SL comprehension, its neural dynamics remain unexplored. We examined the processing of different types of CA (subtle, reduced, and overt) and PT in 35 adult deaf or hearing native signers. The electroencephalographic-based processing of signed sentences with incongruent targets was recorded. Attenuated N300 and early N400 were observed for CA in deaf but not in hearing signers. No differences were found between sentences with CA types in all signers, suggesting a continuum from PT to overt CA. Deaf signers focused more on body movements; hearing signers on faces. We conclude that CA is processed less effortlessly than PT, arguably because of its strong focus on bodily actions.
引用
收藏
页数:11
相关论文
共 75 条
  • [1] What and How the Deaf Brain Sees
    Alencar, Caroline D. C.
    Butler, Blake E.
    Lomber, Stephen G.
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2019, 31 (08) : 1091 - 1109
  • [2] Arendsen J., 2007, Gesture, V7, P305, DOI DOI 10.1075/GEST.7.3.03ARE
  • [3] Two cognitive and neural systems for endogenous and exogenous spatial attention
    Chica, Ana B.
    Bartolomeo, Paolo
    Lupianez, Juan
    [J]. BEHAVIOURAL BRAIN RESEARCH, 2013, 237 : 107 - 123
  • [4] QUOTATIONS AS DEMONSTRATIONS
    CLARK, HH
    GERRIG, RJ
    [J]. LANGUAGE, 1990, 66 (04) : 764 - 805
  • [5] EVENT-RELATED POTENTIAL COMPONENTS REFLECT PHONOLOGICAL AND SEMANTIC PROCESSING OF THE TERMINAL WORD OF SPOKEN SENTENCES
    CONNOLLY, JF
    PHILLIPS, NA
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 1994, 6 (03) : 256 - 266
  • [6] Neural correlates of human action observation in hearing and deaf subjects
    Corina, David
    Chiu, Yi-Shiuan
    Knapp, Heather
    Greenwald, Ralf
    San Jose-Robertson, Lucia
    Braun, Allen
    [J]. BRAIN RESEARCH, 2007, 1152 : 111 - 129
  • [7] Rethinking constructed action
    Cormier, Kearsy
    Smith, Sandra
    Sehyr, Zed Sevcikova
    [J]. SIGN LANGUAGE & LINGUISTICS, 2015, 18 (02) : 167 - 204
  • [8] A piece of the action: Modulation of sensory-motor regions by action idioms and metaphors
    Desai, Rutvik H.
    Conant, Lisa L.
    Binder, Jeffrey R.
    Park, Haeil
    Seidenberg, Mark S.
    [J]. NEUROIMAGE, 2013, 83 : 862 - 869
  • [9] Native language status of the listener modulates the neural integration of speech and iconic gestures in clear and adverse listening conditions
    Drijvers, Linda
    Ozyurek, Asli
    [J]. BRAIN AND LANGUAGE, 2018, 177 : 7 - 17
  • [10] Dye M. W. G., 2006, PAPERS LAB PHONOLOGY, V8, P243