The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing

被引:253
作者
Altmann, Gerry T. M. [1 ]
Kamide, Yuki
机构
[1] Univ York, Dept Psychol, York YO10 5DD, N Yorkshire, England
[2] Univ Dundee, Sch Psychol, Dundee DD1 4HN, Scotland
基金
英国医学研究理事会;
关键词
language-mediated eye movements; affordances; visual attention; SPOKEN-LANGUAGE; SPREADING ACTIVATION; UPCOMING WORDS; LEXICAL ACCESS; COMPREHENSION; PERCEPTION; OBJECT; MODELS; ROLES; SPACE;
D O I
10.1016/j.jml.2006.12.004
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Two experiments explored the representational basis for anticipatory eye movements. Participants heard 'the man will drink...' or 'the man has drunk...' (Experiment 1) or 'the man will drink all of...' or 'the man has drunk all of...' (Experiment 2). They viewed a concurrent scene depicting a full glass of beer and an empty wine glass (amongst other things). There were more saccades towards the empty wine glass in the past tensed conditions than in the future tense conditions; the converse pattern obtained for looks towards the full glass of beer. We argue that these anticipatory eye movements reflect sensitivity to objects' affordances, and develop an account of the linkage between language processing and visual attention that can account not only for looks towards named objects, but also for those cases (including anticipatory eye movements) where attention is directed towards objects that are not being named. (c) 2007 Elsevier Inc. All rights reserved.
引用
收藏
页码:502 / 518
页数:17
相关论文
共 66 条
  • [1] Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models
    Allopenna, PD
    Magnuson, JS
    Tanenhaus, MK
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) : 419 - 439
  • [2] Language-mediated eye movements in the absence of a visual world: the 'blank screen paradigm'
    Altmann, GTM
    [J]. COGNITION, 2004, 93 (02) : B79 - B87
  • [3] Incremental interpretation at verbs: restricting the domain of subsequent reference
    Altmann, GTM
    Kamide, Y
    [J]. COGNITION, 1999, 73 (03) : 247 - 264
  • [4] [Anonymous], 2013, The Interface of Language, Vision, and Action
  • [5] [Anonymous], 2004, Semantic Cognition: A Parallel Distributed Processing Approach
  • [6] Deictic codes for the embodiment of cognition
    Ballard, DH
    Hayhoe, MM
    Pook, PK
    Rao, RPN
    [J]. BEHAVIORAL AND BRAIN SCIENCES, 1997, 20 (04) : 723 - +
  • [7] Modelling parsing constraints with high-dimensional context space
    Burgess, C
    Lund, K
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 1997, 12 (2-3): : 177 - 210
  • [8] Actions and affordances in syntactic ambiguity resolution
    Chambers, CG
    Tanenhaus, MK
    Magnuson, JS
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2004, 30 (03) : 687 - 696
  • [9] Circumscribing referential domains during real-time language comprehension
    Chambers, CG
    Tanenhaus, MK
    Eberhard, KM
    Filip, H
    Carlson, GN
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 2002, 47 (01) : 30 - 49
  • [10] Just like new: Newly segregated old objects capture attention
    Christ, Shawn E.
    Abrams, Richard A.
    [J]. PERCEPTION & PSYCHOPHYSICS, 2006, 68 (02): : 301 - 309