Multimodal language processing in school-aged Mandarin-speaking children: the role of beat gesture in enhancing memory for discourse information

被引:0
作者
Yan, Mengzhu [1 ,2 ]
Xiong, Tianqi [1 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Wuhan, Peoples R China
[2] HUST GYENNO CNS Intelligent Digital Med Technol Ct, Wuhan, Peoples R China
[3] Xiangyang Tianjiabing Sr Sch, Xiangyang, Hubei, Peoples R China
来源
LINGUISTICS VANGUARD | 2025年
关键词
beat gesture; memory; discourse information; Mandarin; children; (sic)(sic)(sic)(sic); (sic)(sic); (sic)(sic)(sic); PITCH ACCENT; INTONATION; COMPREHENSION; ENGLISH; RECALL; FOCUS;
D O I
10.1515/lingvan-2023-0150
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Communication is typically multimodal, meaning that communication involves the utilization of various cues from different modalities. While spoken words in the auditory modality primarily convey semantic information, gestures from the visual modality complement and enhance the communication process. However, the role of visual cues, specifically beat gestures, a type of non-verbal co-speech gesture used to emphasize certain information, in language processing remains largely underexplored. The present study, using a memory task where 90 Mandarin-speaking schoolchildren aged 6-9 viewed stories individually and were later asked about what happened in the stories, investigates the role of beat gestures in enhancing the memory for discourse information in Mandarin. The results show that words with beat gestures were generally recalled better for children of all grades, indicating that by age 6, Mandarin children have already acquired the ability to utilize beat gestures to encode a discourse. This study contributes significantly to our limited understanding of the significance of visual cues in multimodal language processing. (sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)((sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic))(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)90(sic)(sic)(sic)(sic)6(sic)9(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic),(sic)(sic)(sic)6(sic)(sic),(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic)(sic).
引用
收藏
页数:9
相关论文
共 38 条
[1]  
Akker Evelien., 2003, Bilingualism, V6, P81, DOI [10.1017/s1366728903001056, 10.1017/S1366728903001056, DOI 10.1017/S1366728903001056]
[2]   Presentation and production: The role of gesture in spatial communication [J].
Austin, Elizabeth E. ;
Sweller, Naomi .
JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2014, 122 :92-103
[3]   OBSERVING AND PRODUCING PITCH GESTURES FACILITATES THE LEARNING OF MANDARIN CHINESE TONES AND WORDS [J].
Baills, Florence ;
Suarez-Gonzalez, Nerea ;
Gonzalez-Fuente, Santiago ;
Prieto, Pilar .
STUDIES IN SECOND LANGUAGE ACQUISITION, 2019, 41 (01) :33-58
[4]  
Bates D, 2018, Arxiv, DOI [arXiv:1506.04967, DOI 10.48550/ARXIV.1506.04967]
[5]   Replication of Cutler, A., & Fodor, J. A. (1979). Semantic focus and sentence comprehension. Cognition, 7(1), 49-59 [J].
Beier, Eleonora J. ;
Ferreira, Fernanda .
JOURNAL OF MEMORY AND LANGUAGE, 2022, 126
[6]   Beat gestures influence which speech sounds you hear [J].
Bosker, Hans Rutger ;
Peeters, David .
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2021, 288 (1943)
[7]   Understanding Prosodic Focus Marking in Mandarin Chinese: Data from Children and Adults [J].
Chen, Hui-Ching ;
Szendroi, Krista ;
Crain, Stephen ;
Hoehle, Barbara .
JOURNAL OF PSYCHOLINGUISTIC RESEARCH, 2019, 48 (01) :19-32
[8]   INTONATION COMPREHENSION IN 10-YEAR-OLDS [J].
CRUTTENDEN, A .
JOURNAL OF CHILD LANGUAGE, 1985, 12 (03) :643-661
[9]   Prosody in the comprehension of spoken language: A literature review [J].
Cutler, A ;
Dahan, D ;
vanDonselaar, W .
LANGUAGE AND SPEECH, 1997, 40 :141-201
[10]   PHONEME-MONITORING REACTION-TIME AS A FUNCTION OF PRECEDING INTONATION CONTOUR [J].
CUTLER, A .
PERCEPTION & PSYCHOPHYSICS, 1976, 20 (01) :55-60