Temporal modulations in speech and music

被引:306
作者
Ding, Nai [1 ,2 ,3 ,5 ]
Patel, Aniruddh D. [4 ,7 ]
Chen, Lin [1 ,5 ]
Butler, Henry [4 ]
Luo, Cheng [1 ]
Poeppel, David [5 ,6 ]
机构
[1] Zhejiang Univ, Coll Biomed Engn & Instrument Sci, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, Interdisciplinary Ctr Social Sci, Hangzhou, Zhejiang, Peoples R China
[3] Zhejiang Univ Finance & Econ, Neuro & Behav EconLab, Hangzhou, Zhejiang, Peoples R China
[4] Tufts Univ, Dept Psychol, Medford, MA 02155 USA
[5] NYU, Dept Psychol, 6 Washington Pl, New York, NY 10003 USA
[6] Max Planck Inst Empir Aesthet, Frankfurt, Germany
[7] Canadian Inst Adv Res CIFAR, Azrieli Program Brain Mind & Consciousness, Toronto, ON, Canada
基金
中国国家自然科学基金;
关键词
Speech; Music; Rhythm; Temporal modulations; Modulation spectrum; NEURONAL ENTRAINMENT; CORTICAL ENTRAINMENT; BEAT; OSCILLATIONS; PERCEPTION; RESPONSES; TRACKING; RHYTHM; REPRESENTATIONS; PERSPECTIVE;
D O I
10.1016/j.neubiorev.2017.02.011
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Speech and music have structured rhythms. Here we discuss a major acoustic correlate of spoken and musical rhythms, the slow (0.25-32 Hz) temporal modulations in sound intensity and compare the modulation properties of speech and music. We analyze these modulations using over 25 h of speech and over 39 h of recordings of Western music. We show that the speech modulation spectrum is highly consistent across 9 languages (including languages with typologically different rhythmic characteristics). A different, but similarly consistent modulation spectrum is observed for music, including classical music played by single instruments of different types, symphonic, jazz, and rock. The temporal modulations of speech and music show broad but well-separated peaks around 5 and 2 Hz, respectively. These acoustically dominant time scales may be intrinsic features of speech and music, a possibility which should be investigated using more culturally diverse samples in each domain. Distinct modulation timescales for speech and music could facilitate their perceptual analysis and its neural processing. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:181 / 187
页数:7
相关论文
共 69 条
[1]   Orthogonal acoustic dimensions define auditory field maps in human cortex [J].
Barton, Brian ;
Venezia, Jonathan H. ;
Saberi, Kourosh ;
Hickok, Gregory ;
Brewer, Alyssa A. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (50) :20738-20743
[2]   Universals in the world's musics [J].
Brown, Steven ;
Jordania, Joseph .
PSYCHOLOGY OF MUSIC, 2013, 41 (02) :229-248
[3]   The Natural Statistics of Audiovisual Speech [J].
Chandrasekaran, Chandramouli ;
Trubanova, Andrea ;
Stillittano, Sebastien ;
Caplier, Alice ;
Ghazanfar, Asif A. .
PLOS COMPUTATIONAL BIOLOGY, 2009, 5 (07)
[4]   Multiresolution spectrotemporal analysis of complex sounds [J].
Chi, T ;
Ru, PW ;
Shamma, SA .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2005, 118 (02) :887-906
[5]   Spectro-temporal modulation transfer functions and speech intelligibility [J].
Chi, TS ;
Gao, YJ ;
Guyton, MC ;
Ru, PW ;
Shamma, S .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1999, 106 (05) :2719-2732
[6]   Modeling auditory processing of amplitude modulation .2. Spectral and temporal integration [J].
Dau, T ;
Kollmeier, B ;
Kohlrausch, A .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1997, 102 (05) :2906-2919
[7]   Modeling auditory processing of amplitude modulation .1. Detection and masking with narrow-band carriers [J].
Dau, T ;
Kollmeier, B ;
Kohlrausch, A .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1997, 102 (05) :2892-2905
[8]  
De Coensel B, 2003, ACTA ACUST UNITED AC, V89, P287
[9]  
Delgutte B., 1998, PSYCHOPHYSICAL PHYSL, P595
[10]   Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing [J].
Di Liberto, Giovanni M. ;
O'Sullivan, James A. ;
Lalor, Edmund C. .
CURRENT BIOLOGY, 2015, 25 (19) :2457-2465