Event-related Potentials in Audio–Visual Cross-Modal Test for Comparison of Word Pairs

被引:1
|
作者
Nikishena I.S. [1 ]
Ponomarev V.A. [1 ]
Kropotov Y.D. [1 ]
机构
[1] Bechtereva Institute of the Human Brain, Russian Academy of Sciences, St. Petersburg
关键词
cross-modal interaction; event-related potentials; two-modal GO–NOGO paradigm; word’s phonological representation; working memory;
D O I
10.1134/S0362119721020109
中图分类号
学科分类号
摘要
Abstract: The study was aimed at investigating specificities of brain functioning when comparing verbal signals in cross-modal interaction. Event-related potentials (ERPs) were recorded in 166 healthy subjects in a two-modal, two-stimulus test in the GO–NOGO paradigm where the first stimulus was a visual presentation of the word, and the second stimulus was an auditory presentation of the word. It was shown that while the subjects were waiting for the spoken word to follow the printed word, an activation was recorded in the frontal-temporal area of their left hemisphere (F7, F3), presumably associated with the formation of the word’s phonological representation in the memory. Upon producing the second (spoken) word if it coincides with the visual presentation, the peak activation is recorded in the posterior temporal positions (Т5, Т6) within the interval of 370–500 ms; if the second stimulus does not coincide with the first one, the peak activation is recorded in the occipital positions (O1, O2) within the interval of 590–800 ms. These ERP fluctuations supposedly result from the processes of comparing the newly received auditory information with the phonological representation of the word stored in the working memory. © 2021, Pleiades Publishing, Inc.
引用
收藏
页码:459 / 466
页数:7
相关论文
共 50 条
  • [41] Event-related potentials associated with somatosensory effect in audio-visual speech perception
    Ito, Takayuki
    Ohashi, Hiroki
    Montas, Eva
    Gracco, Vincent L.
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 669 - 673
  • [42] SEQUENTIAL EFFECTS ON EVENT-RELATED POTENTIALS - COMPARISON OF AUDITORY AND VISUAL MODALITIES
    SQUIRES, KC
    PETUCHOWSKI, S
    WICKENS, C
    DONCHIN, E
    PSYCHOPHYSIOLOGY, 1977, 14 (01) : 96 - 96
  • [43] Event-Related Potentials of the Human Brain during the Comparison of Visual Stimuli
    Nikishena I.S.
    Ponomarev V.A.
    Kropotov J.D.
    Human Physiology, 2023, 49 (3) : 264 - 273
  • [44] Cross-modal links in endogenous spatial attention are mediated by common external locations: evidence from event-related brain potentials
    Martin Eimer
    Daniel Cockburn
    Ben Smedley
    Jon Driver
    Experimental Brain Research, 2001, 139 : 398 - 411
  • [45] Cross-modal links in endogenous spatial attention are mediated by common external locations: evidence from event-related brain potentials
    Eimer, M
    Cockburn, D
    Smedley, B
    Driver, J
    EXPERIMENTAL BRAIN RESEARCH, 2001, 139 (04) : 398 - 411
  • [46] Audio/visual mapping with cross-modal hidden Markov models
    Fu, SL
    Gutierrez-Osuna, R
    Esposito, A
    Kakumanu, PK
    Garcia, ON
    IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (02) : 243 - 252
  • [47] Audio-Visual Instance Discrimination with Cross-Modal Agreement
    Morgado, Pedro
    Vasconcelos, Nuno
    Misra, Ishan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12470 - 12481
  • [48] Cross-Modal Analysis of Audio-Visual Film Montage
    Zeppelzauer, Matthias
    Mitrovic, Dalibor
    Breiteneder, Christian
    2011 20TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN), 2011,
  • [49] Evidence for Cross-Modal Integration of Emotional Audio/Visual Stimuli
    Woloszyn, Michael Richard
    Lauriente, Teagan Lee
    CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2016, 70 (04): : 425 - 426
  • [50] Cross-Modal learning for Audio-Visual Video Parsing
    Lamba, Jatin
    Abhishek
    Akula, Jayaprakash
    Dabral, Rishabh
    Jyothi, Preethi
    Ramakrishnan, Ganesh
    INTERSPEECH 2021, 2021, : 1937 - 1941