On the mental representations originating during the interaction between language and vision

被引:20
|
作者
Mishra, Ramesh Kumar [1 ]
Marmolejo-Ramos, Fernando [2 ,3 ]
机构
[1] Univ Allahabad, Ctr Behav & Cognit Sci, Allahabad 211002, Uttar Pradesh, India
[2] Univ Adelaide, Fac Hlth Sci, Sch Psychol, Adelaide, SA, Australia
[3] Univ Valle, Inst Psychol, Cali, Colombia
关键词
Visual attention; Eye movements; Language comprehension; Embodied cognition; SPOKEN-WORD RECOGNITION; MEDIATED EYE-MOVEMENTS; VISUAL CONTEXT; TIME-COURSE; SCENE; PERCEPTION; ATTENTION; MOTOR; COMPREHENSION; AFFORDANCES;
D O I
10.1007/s10339-010-0363-y
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved In this paper, we first review some of the theoretical and methodological issues in the current vision language interaction debate Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact
引用
收藏
页码:295 / 305
页数:11
相关论文
共 50 条
  • [21] The Relationship Between Mental Representations of Welfare Recipients and Attitudes Toward Welfare
    Brown-Iannuzzi, Jazmin L.
    Dotsch, Ron
    Cooley, Erin
    Payne, B. Keith
    PSYCHOLOGICAL SCIENCE, 2017, 28 (01) : 92 - 103
  • [22] The conceptual cueing database: Rated items for the study of the interaction between language and attention
    Goodhew, Stephanie C.
    Kidd, Evan
    BEHAVIOR RESEARCH METHODS, 2016, 48 (03) : 1004 - 1007
  • [23] The conceptual cueing database: Rated items for the study of the interaction between language and attention
    Stephanie C. Goodhew
    Evan Kidd
    Behavior Research Methods, 2016, 48 : 1004 - 1007
  • [24] CLVIN: Complete language-vision interaction network for visual question answering
    Chen, Chongqing
    Han, Dezhi
    Shen, Xiang
    KNOWLEDGE-BASED SYSTEMS, 2023, 275
  • [25] Not Doing What You Are Told: Early Perseverative Errors in Updating Mental Representations via Language
    Ganea, Patricia A.
    Harris, Paul L.
    CHILD DEVELOPMENT, 2010, 81 (02) : 457 - 463
  • [26] EVENT-RELATED POTENTIAL CORRELATES OF THE INTERACTION BETWEEN ATTENTION AND SPATIOTEMPORAL CONTEXT REGULARITY IN VISION
    Pollux, P. M. J.
    Hall, S.
    Roebuck, H.
    Guo, K.
    NEUROSCIENCE, 2011, 190 : 258 - 269
  • [27] Expecting the unexpected: Examining the interplay between real-world knowledge and contextual cues during language comprehension
    Jiang, Chengjie
    Filik, Ruth
    MEMORY & COGNITION, 2025,
  • [28] Modeling the Interaction Between Blur and Automobile Tinting Films on Vision
    Martin, A.
    Barrionuevo, P. A.
    Santillan, J. E.
    Lansingh, V.
    Nano, M. E.
    Colombo, E. M.
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2010, 51 (13)
  • [30] Interaction between image and text during the process of biblical art reception
    Hardiess, Gregor
    Weissert, Caecilie
    JOURNAL OF EYE MOVEMENT RESEARCH, 2020, 13 (02): : 1 - 17