Eye activity tracks task-relevant structures during speech and auditory sequence perception

被引:28
作者
Jin, Peiqing [1 ]
Zou, Jiajie [1 ]
Zhou, Tao [1 ]
Ding, Nai [1 ,2 ,3 ]
机构
[1] Zhejiang Univ, Interdisciplinary Inst Neurosci & Technol, Coll Biomed Engn & Instrument Sci,Minist Educ, Key Lab Biomed Engn,Qiushi Acad Adv Studies, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou 310027, Zhejiang, Peoples R China
[3] Zhejiang Univ, Interdisciplinary Ctr Social Sci, Hangzhou 310027, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
NEURONAL OSCILLATIONS; MOTOR THEORY; ATTENTION; RESPONSES; ENTRAINMENT; PERSPECTIVE; INTEGRATION; DYNAMICS; PATTERNS; OPINION;
D O I
10.1038/s41467-018-07773-y
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The sensory and motor systems jointly contribute to complex behaviors, but whether motor systems are involved in high-order perceptual tasks such as speech and auditory comprehension remain debated. Here, we show that ocular muscle activity is synchronized to mentally constructed sentences during speech listening, in the absence of any sentencerelated visual or prosodic cue. Ocular tracking of sentences is observed in the vertical electrooculogram (EOG), whether the eyes are open or closed, and in eye blinks measured by eyetracking. Critically, the phase of sentence-tracking ocular activity is strongly modulated by temporal attention, i.e., which word in a sentence is attended. Ocular activity also tracks highlevel structures in non-linguistic auditory and visual sequences, and captures rapid fluctuations in temporal attention. Ocular tracking of non-visual rhythms possibly reflects global neural entrainment to task-relevant temporal structures across sensory and motor areas, which could serve to implement temporal attention and coordinate cortical networks.
引用
收藏
页数:15
相关论文
共 75 条
[1]  
[Anonymous], 1993, An introduction to the bootstrap
[2]  
[Anonymous], PHIL T R SOC LOND B
[3]   Cortical oscillations and sensory predictions [J].
Arnal, Luc H. ;
Giraud, Anne-Lise .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (07) :390-398
[4]   The coupling between auditory and motor cortices is rate-restricted: Evidence for an intrinsic speech-motor rhythm [J].
Assaneo, M. Florencia ;
Poeppel, David .
SCIENCE ADVANCES, 2018, 4 (02)
[5]   Listeners modulate temporally selective attention during natural speech processing [J].
Astheimer, Lori B. ;
Sanders, Lisa D. .
BIOLOGICAL PSYCHOLOGY, 2009, 80 (01) :23-34
[6]   TASK-EVOKED PUPILLARY RESPONSES, PROCESSING LOAD, AND THE STRUCTURE OF PROCESSING RESOURCES [J].
BEATTY, J .
PSYCHOLOGICAL BULLETIN, 1982, 91 (02) :276-292
[7]   NEW OBSERVATIONS ON THE NORMAL AUDITORY STARTLE REFLEX IN MAN [J].
BROWN, P ;
ROTHWELL, JC ;
THOMPSON, PD ;
BRITTON, TC ;
DAY, BL ;
MARSDEN, CD .
BRAIN, 1991, 114 :1891-1902
[8]   The Natural Statistics of Audiovisual Speech [J].
Chandrasekaran, Chandramouli ;
Trubanova, Andrea ;
Stillittano, Sebastien ;
Caplier, Alice ;
Ghazanfar, Asif A. .
PLOS COMPUTATIONAL BIOLOGY, 2009, 5 (07)
[9]   Listening to Musical Rhythms Recruits Motor Regions of the Brain [J].
Chen, Joyce L. ;
Penhune, Virginia B. ;
Zatorre, Robert J. .
CEREBRAL CORTEX, 2008, 18 (12) :2844-2854
[10]   A glimpsing model of speech perception in noise [J].
Cooke, M .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2006, 119 (03) :1562-1573