SEEING SPEECH - VISUAL INFORMATION FROM LIP MOVEMENTS MODIFIES ACTIVITY IN THE HUMAN AUDITORY-CORTEX

被引：264

作者：

SAMS, M ^{[1
]}

AULANKO, R ^{[1
]}

HAMALAINEN, M ^{[1
]}

HARI, R ^{[1
]}

LOUNASMAA, OV ^{[1
]}

LU, ST ^{[1
]}

SIMOLA, J ^{[1
]}

机构：

[1] UNIV HELSINKI, DEPT PHONET, SF-00100 HELSINKI 10, FINLAND

来源：

NEUROSCIENCE LETTERS | 1991年 / 127卷 / 01期

关键词：

AUDITION; AUDITORY CORTEX; AUDIOVISUAL INTERACTION; INTERSENSORY CONVERGENCE; EVOKED RESPONSES; MEG; SPEECH PERCEPTION; NEUROMAGNETISM; MAN;

D O I：

10.1016/0304-3940(91)90914-F

中图分类号：

Q189 [神经科学];

学科分类号：

071006 ;

摘要：

Neuromagnetic responses were recorded over the left hemisphere to find out in which cortical area the heard and seen speech are integrated. Auditory stimuli were Finnish /pa/syllables presented together with a videotaped face articulating either the concordant syllable /pa/ (84% of stimuli, V = A) or the discordant syllable /ka/ (16%, V not-equal A). In some subjects the probabilities were reversed. The subjects heard V not-equal A stimuli as /ta/ or /ka/. The magnetic responses to infrequent perceptions elicited a specific waveform which could be explained by activity in the supratemporal auditory cortex. The results show that visual information from articulatory movements has an entry into the auditory cortex.

引用

页码：141 / 145

页数：5

共 18 条

[1] AUDITORY-VISUAL INTERACTION IN SINGLE CELLS IN CORTEX OF SUPERIOR TEMPORAL SULCUS AND ORBITAL FRONTAL CORTEX OF MACAQUE MONKEY [J].

BENEVENTO, LA ;

FALLON, J ;

DAVIS, BJ ;

REZAK, M .

EXPERIMENTAL NEUROLOGY, 1977, 57 (03) :849-872

[2] CONVERGENCE OF AUDITORY AND VISUAL STIMULI ON SINGLE CELLS IN PRIMARY VISUAL CORTEX OF UNANESTHETIZED UNRESTRAINED CATS [J].

BENTAL, E ;

DAFNY, N ;

FELDMAN, S .

EXPERIMENTAL NEUROLOGY, 1968, 20 (03) :341-+

[3] AUDITORY AND VISUAL CONTRIBUTIONS TO PERCEPTION OF CONSONANTS [J].

BINNIE, CA ;

MONTGOMERY, AA ;

JACKSON, PL .

JOURNAL OF SPEECH AND HEARING RESEARCH, 1974, 17 (04) :619-630

[4]

CAMBELL R, 1987, HEARING EYE PSYCHOL, P215

[5] ROLE OF VISION IN PERCEPTION OF SPEECH [J].

DODD, B .

PERCEPTION, 1977, 6 (01) :31-40

[6]

ELBERLING C, 1980, SCAND AUDIOL, V9, P185, DOI [10.3109/01050398009076353, 10.3109/01050397909076320]

[7] DISCONNEXION SYNDROMES IN ANIMALS AND MAN [J].

GESCHWIN.N .

BRAIN, 1965, 88 :237-+

[8] RECORDING AND INTERPRETATION OF CEREBRAL MAGNETIC-FIELDS [J].

HARI, R ;

LOUNASMAA, OV .

SCIENCE, 1989, 244 (4903) :432-436

[9] AUDITORY EVOKED TRANSIENT AND SUSTAINED MAGNETIC-FIELDS OF THE HUMAN-BRAIN - LOCALIZATION OF NEURAL GENERATORS [J].

HARI, R ;

AITTONIEMI, K ;

JARVINEN, ML ;

KATILA, T ;

VARPULA, T .

EXPERIMENTAL BRAIN RESEARCH, 1980, 40 (02) :237-240

[10] POLYSENSORY PROPERTIES OF NEURONS IN THE ANTERIOR BANK OF THE CAUDAL SUPERIOR TEMPORAL SULCUS OF THE MACAQUE MONKEY [J].

HIKOSAKA, K ;

IWAI, E ;

SAITO, HA ;

TANAKA, K .

JOURNAL OF NEUROPHYSIOLOGY, 1988, 60 (05) :1615-1637

← 1 2 →