The Impact and Status of Carol Fowler's Supramodal Theory of Multisensory Speech Perception

被引:12
作者
Rosenblum, Lawrence D. [1 ]
Dorsi, Josh [1 ]
Dias, James W. [1 ]
机构
[1] Univ Calif Riverside, Dept Psychol, 900 Univ Ave, Riverside, CA 92521 USA
关键词
VISUAL SPEECH; SELECTIVE ADAPTATION; PREMOTOR CORTEX; MOTOR CORTEX; AUDITORY SPEECH; LIP MOVEMENTS; BRAIN-REGIONS; TALKING FACES; BROCAS AREA; PHONETIC CONVERGENCE;
D O I
10.1080/10407413.2016.1230373
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
One important contribution of Carol Fowler's direct approach to speech perception is its account of multisensory perception. This supramodal account proposes a speech function that detects supramodal information available across audition, vision, and touch. This detection allows for the recovery of articulatory primitives that provide the basis of a common currency shared between modalities as well as between perception and production. Common currency allows for perceptual experience to be shared between modalities and supports perceptually guided speaking as well as production-guided perception. In this report, we discuss the contribution and status of the supramodal approach relative to recent research in multisensory speech perception. We argue that the approach has helped motivate a multisensory revolution in perceptual psychology. We then review the new behavioral and neurophysiological research on (a) supramodal information, (b) cross-sensory sharing of experience, and (c) perceptually guided speaking as well as production guided speech perception. We conclude that Fowler's supramodal theory has fared quite well in light of this research.
引用
收藏
页码:262 / 294
页数:33
相关论文
共 228 条
[1]   Enhanced neural synchrony between left auditory and prernotor cortex is associated with successful phonetic categorization [J].
Alho, Jussi ;
Lin, Fa-Hsuan ;
Sato, Marc ;
Tiitinen, Hannu ;
Sams, Mikko ;
Jaaskelainen, Iiro P. .
FRONTIERS IN PSYCHOLOGY, 2014, 5
[2]   Some Behavioral and Neurobiological Constraints on Theories of Audiovisual Speech Integration: A Review and Suggestions for New Directions [J].
Altieri, Nicholas ;
Pisoni, David B. ;
Townsend, James T. .
SEEING AND PERCEIVING, 2011, 24 (06) :513-539
[3]   Audiovisual integration of speech in a patient with Broca's Aphasia [J].
Andersen, Tobias S. ;
Starrfelt, Randi .
FRONTIERS IN PSYCHOLOGY, 2015, 6
[4]   The motion aftereffect as a universal phenomenon for sensory systems involved in spatial orientation: I. Visual aftereffects [J].
Andreeva, I. G. .
JOURNAL OF EVOLUTIONARY BIOCHEMISTRY AND PHYSIOLOGY, 2014, 50 (06) :475-482
[5]  
[Anonymous], 1986, The Ecological Approach toVisual Perception
[6]  
[Anonymous], 1998, Perceiving talking faces: From speech perception to a behavioral principle, MIT Press/Bradford Books series in cognitive psychology
[7]  
[Anonymous], 1966, The ecological approach to visual perception
[8]   Vibrotactile activation of the auditory cortices in deaf versus hearing adults [J].
Auer, Edward T., Jr. ;
Bernstein, Lynne E. ;
Sungkarat, Witaya ;
Singh, Manbir .
NEUROREPORT, 2007, 18 (07) :645-648
[9]   Visual rhythm perception improves through auditory but not visual training [J].
Barakat, Brandon ;
Seitz, Aaron R. ;
Shams, Ladan .
CURRENT BIOLOGY, 2015, 25 (02) :R60-R61
[10]   PHONEMIC IDENTIFICATION DEFECT IN APHASIA [J].
BASSO, A ;
CASATI, G ;
VIGNOLO, LA .
CORTEX, 1977, 13 (01) :85-95