The pieces fit: Constituent structure and global coherence of visual narrative in RSVP

被引:9
作者
Hagmann, Carl Erick [1 ]
Cohn, Neil [2 ]
机构
[1] MIT, Dept Brain & Cognit Sci, E25-618, Cambridge, MA 02139 USA
[2] Univ Calif San Diego, Dept Cognit Sci, La Jolla, CA 92093 USA
基金
美国国家卫生研究院;
关键词
Visual language; Comics; Constituent structure; Visual cognition; Narrative; RSVP; LANGUAGE; EVENTS; MEMORY;
D O I
10.1016/j.actpsy.2016.01.011
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Recent research has shown that comprehension of visual narrative relies on the ordering and timing of sequential images. Here we tested if rapidly presented 6-image long visual sequences could be understood as coherent narratives. Half of the sequences were correctly ordered and half had two of the four internal panels switched. Participants reported whether the sequence was correctly ordered and rated its coherence. Accuracy in detecting a switch increased when panels were presented for 1 s rather than 0.5 s. Doubling the duration of the first panel did not affect results. When two switched panels were further apart, order was discriminated more accurately and coherence ratings were low, revealing that a strong local adjacency effect influenced order and coherence judgments. Switched panels at constituent boundaries or within constituents were most disruptive to order discrimination, indicating that the preservation of constituent structure is critical to visual narrative grammar. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:157 / 164
页数:8
相关论文
共 53 条
[1]  
[Anonymous], THE GRAPHIC NOVEL
[2]  
[Anonymous], 1994, UNDERSTANDING COMICS
[3]   Neural circuits of hierarchical visuo-spatial sequence processing [J].
Bahlmann, Joerg ;
Schubotz, Ricarda I. ;
Mueller, Jutta L. ;
Koester, Dirk ;
Friederici, Angela D. .
BRAIN RESEARCH, 2009, 1298 :161-170
[4]   Recommended effect size statistics for repeated measures designs [J].
Bakeman, R .
BEHAVIOR RESEARCH METHODS, 2005, 37 (03) :379-384
[5]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[6]  
Cohn N., 2014, COGNITIVE SCI
[7]   Drawing the Line Between Constituent Structure and Coherence Relations in Visual Narratives [J].
Cohn, Neil ;
Bender, Patrick .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2017, 43 (02) :289-301
[8]   Action starring narratives and events: Structure and inference in visual narrative comprehension [J].
Cohn, Neil ;
Wittenberg, Eva .
JOURNAL OF COGNITIVE PSYCHOLOGY, 2015, 27 (07) :812-828
[9]   The notion of the motion: The neurocognition of motion lines in visual narratives [J].
Cohn, Neil ;
Maher, Stephen .
BRAIN RESEARCH, 2015, 1601 :73-84
[10]   The grammar of visual narrative: Neural evidence for constituent structure in sequential image comprehension [J].
Cohn, Neil ;
Jackendoff, Ray ;
Holcomb, Phillip J. ;
Kuperberg, Gina R. .
NEUROPSYCHOLOGIA, 2014, 64 :63-70