On the mental representations originating during the interaction between language and vision

被引:20
|
作者
Mishra, Ramesh Kumar [1 ]
Marmolejo-Ramos, Fernando [2 ,3 ]
机构
[1] Univ Allahabad, Ctr Behav & Cognit Sci, Allahabad 211002, Uttar Pradesh, India
[2] Univ Adelaide, Fac Hlth Sci, Sch Psychol, Adelaide, SA, Australia
[3] Univ Valle, Inst Psychol, Cali, Colombia
关键词
Visual attention; Eye movements; Language comprehension; Embodied cognition; SPOKEN-WORD RECOGNITION; MEDIATED EYE-MOVEMENTS; VISUAL CONTEXT; TIME-COURSE; SCENE; PERCEPTION; ATTENTION; MOTOR; COMPREHENSION; AFFORDANCES;
D O I
10.1007/s10339-010-0363-y
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved In this paper, we first review some of the theoretical and methodological issues in the current vision language interaction debate Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact
引用
收藏
页码:295 / 305
页数:11
相关论文
共 50 条
  • [1] On the mental representations originating during the interaction between language and vision
    Ramesh Kumar Mishra
    Fernando Marmolejo-Ramos
    Cognitive Processing, 2010, 11 : 295 - 305
  • [2] Interactions Between Language and Mental Representations
    Unal, Ercenur
    Papafragou, Anna
    LANGUAGE LEARNING, 2016, 66 (03) : 554 - 580
  • [3] Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation
    Altmann, Gerry T. M.
    Kamide, Yuki
    COGNITION, 2009, 111 (01) : 55 - 71
  • [4] The activation of object-state representations during online language comprehension
    Kang, Xin
    Joergensen, Gitte H.
    Altmann, Gerry T. M.
    ACTA PSYCHOLOGICA, 2020, 210
  • [5] Early Interaction between Vision and Touch during Binocular Rivalry
    Lunghi, Claudia
    Morrone, M. Concetta
    MULTISENSORY RESEARCH, 2013, 26 (03) : 291 - 306
  • [6] Interaction Between Phonological and Semantic Representations: Time Matters
    Chen, Qi
    Mirman, Daniel
    COGNITIVE SCIENCE, 2015, 39 (03) : 538 - 558
  • [7] Interaction between language and vision: It's momentary, abstract, and it develops
    Dessalegn, Banchiamlack
    Landau, Barbara
    COGNITION, 2013, 127 (03) : 331 - 344
  • [8] Initial Acquisition of Mental Graphemic Representations in Children with Language Impairment
    Wolter, Julie A.
    Apel, Kenn
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2010, 53 (01): : 179 - 195
  • [9] Shared representations of human actions across vision and language
    Dima, Diana C.
    Janarthanan, Sugitha
    Culham, Jody C.
    Mohsenzadeh, Yalda
    NEUROPSYCHOLOGIA, 2024, 202
  • [10] Language concatenates perceptual features into representations during comprehension
    Bocanegra, Bruno R.
    Poletiek, Fenna H.
    Zwaan, Rolf A.
    JOURNAL OF MEMORY AND LANGUAGE, 2022, 127