Visual Recognition Memory of Scenes Is Driven by Categorical, Not Sensory, Visual Representations

被引:4
作者
Morales-Torres, Ricardo [1 ]
Wing, Erik A. [2 ]
Deng, Lifu [1 ]
Davis, Simon W. [1 ,3 ]
Cabeza, Roberto [1 ]
机构
[1] Duke Univ, Dept Psychol & Neurosci, Durham, NC 27708 USA
[2] Baycrest Hlth Sci, Rotman Res Inst, Toronto, ON M6A 2E1, Canada
[3] Duke Univ, Sch Med, Dept Neurol, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
episodic memory; recognition memory; representational similarity analysis; scene memory; SIMILARITY; ACTIVATION; PATTERNS; GEOMETRY; OBJECT; TESTS; GUIDE;
D O I
10.1523/JNEUROSCI.1479-23.2024
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
When we perceive a scene, our brain processes various types of visual information simultaneously, ranging from sensory features, such as line orientations and colors, to categorical features, such as objects and their arrangements. Whereas the role of sensory and categorical visual representations in predicting subsequent memory has been studied using isolated objects, their impact on memory for complex scenes remains largely unknown. To address this gap, we conducted an fMRI study in which female and male participants encoded pictures of familiar scenes (e.g., an airport picture) and later recalled them, while rating the vividness of their visual recall. Outside the scanner, participants had to distinguish each seen scene from three similar lures (e.g., three airport pictures). We modeled the sensory and categorical visual features of multiple scenes using both early and late layers of a deep convolutional neural network. Then, we applied representational similarity analysis to determine which brain regions represented stimuli in accordance with the sensory and categorical models. We found that categorical, but not sensory, representations predicted subsequent memory. In line with the previous result, only for the categorical model, the average recognition performance of each scene exhibited a positive correlation with the average visual dissimilarity between the item in question and its respective lures. These results strongly suggest that even in memory tests that ostensibly rely solely on visual cues (such as forced-choice visual recognition with similar distractors), memory decisions for scenes may be primarily influenced by categorical rather than sensory representations.
引用
收藏
页数:10
相关论文
共 57 条
[1]   An empirical comparison of permutation methods for tests of partial regression coefficients in a linear model [J].
Anderson, MJ ;
Legendre, P .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1999, 62 (03) :271-303
[2]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[3]   Canonical Microcircuits for Predictive Coding [J].
Bastos, Andre M. ;
Usrey, W. Martin ;
Adams, Rick A. ;
Mangun, George R. ;
Fries, Pascal ;
Friston, Karl J. .
NEURON, 2012, 76 (04) :695-711
[4]   Fitting Linear Mixed-Effects Models Using lme4 [J].
Bates, Douglas ;
Maechler, Martin ;
Bolker, Benjamin M. ;
Walker, Steven C. .
JOURNAL OF STATISTICAL SOFTWARE, 2015, 67 (01) :1-48
[5]   Evidence for Implicit-But Not Unconscious-Processing of Object-Scene Relations [J].
Biderman, Natalie ;
Mudrik, Liad .
PSYCHOLOGICAL SCIENCE, 2018, 29 (02) :266-277
[6]   Feature-specific neural reactivation during episodic memory [J].
Bone, Michael B. ;
Ahmad, Fahad ;
Buchsbaum, Bradley R. .
NATURE COMMUNICATIONS, 2020, 11 (01)
[7]   Rethinking Space: A Review of Perception, Attention, and Memory in Scene Processing [J].
Castelhano, Monica S. ;
Krzys, Karolina .
ANNUAL REVIEW OF VISION SCIENCE, VOL 6, 2020, 2020, 6 :563-586
[8]   Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks [J].
Cichy, Radoslaw Martin ;
Khosla, Aditya ;
Pantazis, Dimitrios ;
Oliva, Aude .
NEUROIMAGE, 2017, 153 :346-358
[9]   Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests [J].
Davis, Simon W. ;
Geib, Benjamin R. ;
Wing, Erik A. ;
Wang, Wei-Chun ;
Hovhannisyan, Mariam ;
Monge, Zachary A. ;
Cabeza, Roberto .
CEREBRAL CORTEX, 2021, 31 (02) :974-992
[10]   Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway [J].
Devereux, Barry J. ;
Clarke, Alex ;
Tyler, Lorraine K. .
SCIENTIFIC REPORTS, 2018, 8