Between bodily action and conventionalized structure: The neural mechanisms of constructed action in sign language comprehension

被引:1
作者
Hernandez, Doris [1 ,2 ,4 ]
Puupponen, Anna [1 ]
Keranen, Jarkko [1 ]
Ortega, Gerardo [3 ]
Jantunen, Tommi [1 ]
机构
[1] Univ Jyvaskyla, Dept Language & Commun Studies, Sign Language Ctr, Jyvaskyla, Finland
[2] Univ Jyvaskyla, Ctr Interdisciplinary Brain Res CIBR, Dept Psychol, Jyvaskyla, Finland
[3] Univ Birmingham, Dept English Language & Appl Linguist, Birmingham, England
[4] Univ Jyvaskyla, Finnish Sign Language, Dept Language & Commun Studies, A Bldg,Seminaarinkatu 15, Jyvaskyla 40014, Finland
基金
芬兰科学院;
关键词
Sign language; Constructed action; Plain telling; N300; N400; Bimodal bilingualism; Meaning processing; Bottom-up processing; EEG; ERP; ELECTROPHYSIOLOGICAL EVIDENCE; WORD RECOGNITION; SPEECH; GESTURE; COMPONENT; SPOKEN; MEG; REPRESENTATION; INTEGRATION; ACTIVATION;
D O I
10.1016/j.bandl.2024.105413
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Sign languages (SLs) are expressed through different bodily actions, ranging from re-enactment of physical events (constructed action, CA) to sequences of lexical signs with internal structure (plain telling, PT). Despite the prevalence of CA in signed interactions and its significance for SL comprehension, its neural dynamics remain unexplored. We examined the processing of different types of CA (subtle, reduced, and overt) and PT in 35 adult deaf or hearing native signers. The electroencephalographic-based processing of signed sentences with incongruent targets was recorded. Attenuated N300 and early N400 were observed for CA in deaf but not in hearing signers. No differences were found between sentences with CA types in all signers, suggesting a continuum from PT to overt CA. Deaf signers focused more on body movements; hearing signers on faces. We conclude that CA is processed less effortlessly than PT, arguably because of its strong focus on bodily actions.
引用
收藏
页数:11
相关论文
共 75 条
  • [11] LEXICAL RECOGNITION IN SIGN LANGUAGE - EFFECTS OF PHONETIC STRUCTURE AND MORPHOLOGY
    EMMOREY, K
    CORINA, D
    [J]. PERCEPTUAL AND MOTOR SKILLS, 1990, 71 (03) : 1227 - 1252
  • [12] Bimodal bilingualism
    Emmorey, Karen
    Borinstein, Helsa B.
    Thompson, Robin
    Gollan, Tamar H.
    [J]. BILINGUALISM-LANGUAGE AND COGNITION, 2008, 11 (01) : 43 - 61
  • [13] CNS activation and regional connectivity during pantomime observation: No engagement of the mirror neuron system for deaf signers
    Emmorey, Karen
    Xu, Jiang
    Gannon, Patrick
    Goldin-Meadow, Susan
    Braun, Allen
    [J]. NEUROIMAGE, 2010, 49 (01) : 994 - 1005
  • [14] Learning to associate novel words with motor actions: Language-induced motor activity following short training
    Fargier, Raphael
    Paulignan, Yves
    Boulenger, Veronique
    Monaghan, Padraic
    Reboul, Anne
    Nazir, Tatjana A.
    [J]. CORTEX, 2012, 48 (07) : 888 - 899
  • [15] Meaning and modality: Influences of context, semantic memory organization, and perceptual predictability on picture processing
    Federmeier, KD
    Kutas, M
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2001, 27 (01) : 202 - 224
  • [16] Language as Description, Indication, and Depiction
    Ferrara, Lindsay
    Hodge, Gabrielle
    [J]. FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [17] Elaborating Who's What: A Study of Constructed Action and Clause Structure in Auslan (Australian Sign Language)
    Ferrara, Lindsay
    Johnston, Trevor
    [J]. AUSTRALIAN JOURNAL OF LINGUISTICS, 2014, 34 (02) : 193 - 215
  • [18] Towards a neural basis of auditory sentence processing
    Friederici, AD
    [J]. TRENDS IN COGNITIVE SCIENCES, 2002, 6 (02) : 78 - 84
  • [19] MNE software for processing MEG and EEG data
    Gramfort, Alexandre
    Luessi, Martin
    Larson, Eric
    Engemann, Denis A.
    Strohmeier, Daniel
    Brodbeck, Christian
    Parkkonen, Lauri
    Haemaelaeinen, Matti S.
    [J]. NEUROIMAGE, 2014, 86 : 446 - 460
  • [20] Gutierrez E. M., 2008, Doctoral dissertation