Intrinsic and extrinsic effects on image memorability

被引:167
作者
Bylinskii, Zoya [1 ,2 ,3 ]
Isola, Phillip [2 ,3 ,4 ]
Bainbridge, Constance [2 ,3 ]
Torralba, Antonio [1 ,2 ,3 ]
Oliva, Aude [2 ,3 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02141 USA
[2] MIT, Comp Sci, Cambridge, MA 02141 USA
[3] MIT, Artificial Intelligence Lab, Cambridge, MA 02141 USA
[4] MIT, Dept Brain & Cognit Sci, Cambridge, MA 02141 USA
基金
美国国家科学基金会; 加拿大自然科学与工程研究理事会;
关键词
Image memorability; Eye movements; Scene dataset; Fine-grained categories; Visual distinctiveness; Context; LONG-TERM-MEMORY; EYE-MOVEMENTS; DISTINCTIVENESS; FAMILIARITY; RECOGNITION; TYPICALITY; YARBUS;
D O I
10.1016/j.visres.2015.03.005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Previous studies have identified that images carry the attribute of memorability, a predictive value of whether a novel image will be later remembered or forgotten. Here we investigate the interplay between intrinsic and extrinsic factors that affect image memorability. First, we find that intrinsic differences in memorability exist at a finer-grained scale than previously documented. Second, we test two extrinsic factors: image context and observer behavior. Building on prior findings that images that are distinct with respect to their context are better remembered, we propose an information-theoretic model of image distinctiveness. Our model can automatically predict how changes in context change the memorability of natural images. In addition to context, we study a second extrinsic factor: where an observer looks while memorizing an image. It turns out that eye movements provide additional information that can predict whether or not an image will be remembered, on a trial-by-trial basis. Together, by considering both intrinsic and extrinsic effects on memorability, we arrive at a more complete and finegrained model of image memorability than previously available. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:165 / 178
页数:14
相关论文
共 54 条
[1]  
[Anonymous], IEEE T VISUALIZATION
[2]  
[Anonymous], 1967, Eye movements and vision
[3]  
[Anonymous], INT C COMP VIS ICCV
[4]  
[Anonymous], 2006, DISTINCTIVENESS MEMO
[5]  
[Anonymous], C NEUR INF PROC SYST
[6]  
[Anonymous], 2014, PROCEED
[7]  
Attneave F., 1959, Applications of information theory to psychology: a summary of basic concepts, methods, and results
[8]   The Intrinsic Memorability of Face Photographs [J].
Bainbridge, Wilma A. ;
Isola, Phillip ;
Oliva, Aude .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2013, 142 (04) :1323-1334
[9]   TYPICALITY AND FAMILIARITY OF FACES [J].
BARTLETT, JC ;
HURRY, S ;
THORLEY, W .
MEMORY & COGNITION, 1984, 12 (03) :219-228
[10]   Defending Yarbus: Eye movements reveal observers' task [J].
Borji, Ali ;
Itti, Laurent .
JOURNAL OF VISION, 2014, 14 (03)