Multimodal language processing in school-aged Mandarin-speaking children: the role of beat gesture in enhancing memory for discourse information

被引:0
作者
Yan, Mengzhu [1 ,2 ]
Xiong, Tianqi [1 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Wuhan, Peoples R China
[2] HUST GYENNO CNS Intelligent Digital Med Technol Ct, Wuhan, Peoples R China
[3] Xiangyang Tianjiabing Sr Sch, Xiangyang, Hubei, Peoples R China
来源
LINGUISTICS VANGUARD | 2025年
关键词
beat gesture; memory; discourse information; Mandarin; children; (sic)(sic)(sic)(sic); (sic)(sic); (sic)(sic)(sic); PITCH ACCENT; INTONATION; COMPREHENSION; ENGLISH; RECALL; FOCUS;
D O I
10.1515/lingvan-2023-0150
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Communication is typically multimodal, meaning that communication involves the utilization of various cues from different modalities. While spoken words in the auditory modality primarily convey semantic information, gestures from the visual modality complement and enhance the communication process. However, the role of visual cues, specifically beat gestures, a type of non-verbal co-speech gesture used to emphasize certain information, in language processing remains largely underexplored. The present study, using a memory task where 90 Mandarin-speaking schoolchildren aged 6-9 viewed stories individually and were later asked about what happened in the stories, investigates the role of beat gestures in enhancing the memory for discourse information in Mandarin. The results show that words with beat gestures were generally recalled better for children of all grades, indicating that by age 6, Mandarin children have already acquired the ability to utilize beat gestures to encode a discourse. This study contributes significantly to our limited understanding of the significance of visual cues in multimodal language processing. (sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)((sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic))(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)90(sic)(sic)(sic)(sic)6(sic)9(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic),(sic)(sic)(sic)6(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).
引用
收藏
页数:9
相关论文
共 38 条
[11]   SEMANTIC FOCUS AND SENTENCE COMPREHENSION [J].
CUTLER, A ;
FODOR, JA .
COGNITION, 1979, 7 (01) :49-59
[12]   Pre-schoolers use head gestures rather than prosodic cues to highlight important information in speech [J].
Esteve-Gibert, Nuria ;
Laevenbruck, Helene ;
Dohen, Marion ;
D'Imperio, Mariapaola .
DEVELOPMENTAL SCIENCE, 2022, 25 (01)
[13]   Prosodic Structure Shapes the Temporal Realization of Intonation and Manual Gesture Movements [J].
Esteve-Gibert, Nuria ;
Prieto, Pilar .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2013, 56 (03) :850-864
[14]   Beat gestures improve word recall in 3-to 5-year-old children [J].
Igualada, Alfonso ;
Esteve-Gibert, Nuria ;
Prieto, Pilar .
JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2017, 156 :99-112
[15]  
Im Suyeon, 2020, Proceedings of the LSA, V5, P685, DOI [10.3765/plsa.v5i1.4755, DOI 10.3765/PLSA.V5I1.4755]
[16]   Interpretation of contrastive pitch accent in six- to eleven-year-old English-speaking children (and adults) [J].
Ito, Kiwako ;
Bibyk, Sarah A. ;
Wagner, Laura ;
Speer, Shari R. .
JOURNAL OF CHILD LANGUAGE, 2014, 41 (01) :84-110
[17]   Intonation facilitates contrast resolution: Evidence from Japanese adults and 6-year olds [J].
Ito, Kiwako ;
Jincho, Nobuyuki ;
Minai, Utako ;
Yamane, Naoto ;
Mazuka, Reiko .
JOURNAL OF MEMORY AND LANGUAGE, 2012, 66 (01) :265-284
[18]   Effects of contrastive accents on children's discourse comprehension [J].
Lee, Eun-Kyung ;
Snedeker, Jesse .
PSYCHONOMIC BULLETIN & REVIEW, 2016, 23 (05) :1589-1595
[19]  
Lenth R. V., 2022, EMMEANS ESTIMATED MA
[20]  
Levantinou E. I., 2016, P 3 EUR S MULT COMM, V105, P32