The pieces fit: Constituent structure and global coherence of visual narrative in RSVP

被引:9
作者
Hagmann, Carl Erick [1 ]
Cohn, Neil [2 ]
机构
[1] MIT, Dept Brain & Cognit Sci, E25-618, Cambridge, MA 02139 USA
[2] Univ Calif San Diego, Dept Cognit Sci, La Jolla, CA 92093 USA
基金
美国国家卫生研究院;
关键词
Visual language; Comics; Constituent structure; Visual cognition; Narrative; RSVP; LANGUAGE; EVENTS; MEMORY;
D O I
10.1016/j.actpsy.2016.01.011
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Recent research has shown that comprehension of visual narrative relies on the ordering and timing of sequential images. Here we tested if rapidly presented 6-image long visual sequences could be understood as coherent narratives. Half of the sequences were correctly ordered and half had two of the four internal panels switched. Participants reported whether the sequence was correctly ordered and rated its coherence. Accuracy in detecting a switch increased when panels were presented for 1 s rather than 0.5 s. Doubling the duration of the first panel did not affect results. When two switched panels were further apart, order was discriminated more accurately and coherence ratings were low, revealing that a strong local adjacency effect influenced order and coherence judgments. Switched panels at constituent boundaries or within constituents were most disruptive to order discrimination, indicating that the preservation of constituent structure is critical to visual narrative grammar. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:157 / 164
页数:8
相关论文
共 53 条
[11]   Prediction, events, and the advantage of Agents: The processing of semantic roles in visual narrative [J].
Cohn, Neil ;
Paczynski, Martin .
COGNITIVE PSYCHOLOGY, 2013, 67 (03) :73-97
[12]   Visual Narrative Structure [J].
Cohn, Neil .
COGNITIVE SCIENCE, 2013, 37 (03) :413-452
[13]   (Pea)nuts and bolts of visual narrative: Structure and meaning in sequential image comprehension [J].
Cohn, Neil ;
Paczynski, Martin ;
Jackendoff, Ray ;
Holcomb, Phillip J. ;
Kuperberg, Gina R. .
COGNITIVE PSYCHOLOGY, 2012, 65 (01) :1-38
[14]   Control of goal-directed and stimulus-driven attention in the brain [J].
Corbetta, M ;
Shulman, GL .
NATURE REVIEWS NEUROSCIENCE, 2002, 3 (03) :201-215
[15]  
Davis MH, 2003, J NEUROSCI, V23, P3423
[16]  
Foulsham T., READING WORDS UNPUB
[17]  
Gernsbacher M., 1990, Language comprehension as structure building
[18]   SURFACE INFORMATION LOSS IN COMPREHENSION [J].
GERNSBACHER, MA .
COGNITIVE PSYCHOLOGY, 1985, 17 (03) :324-363
[19]  
Glanzer M., 1984, J VERBAL LEARNING VE
[20]   The Briefest of Glances: The Time Course of Natural Scene Understanding [J].
Greene, Michelle R. ;
Oliva, Aude .
PSYCHOLOGICAL SCIENCE, 2009, 20 (04) :464-472