Ensemble Memory of a Scene Interacts With Current Perception Regardless of Attentional Requirements

How do we maintain a rich and stable perceptual experience across the entire visual scene, even when we are focusing on a subset of visual inputs? The current study explored this question by investigating whether the visual system processes summary statistics of multiple features regardless of task relevance, and how they interact with subsequent perception. To test the processing of multifeature summary statistics under different attentional requirements, we presented multiple Gabor patches with heterogeneous orientations/colors and asked participants to attend to a single feature dimension (Experiments 1 and 3) or a single item (Experiment 2) for the memory task. During the memory maintenance period (before memory response), we asked the participants to perform a discrimination task (Experiments 1 and 2) or a boundary localization task (Experiment 3) to test how the memory of the ensemble representation alters the subsequent perceptual experience. We found evidence for obligatory processing of scene summary statistics presented for the memory task, which interacted with the subsequent perceptual sensitivity. Specifically, not only summary statistics relevant but also those of task-irrelevant feature (Experiments 1 and 3) and outside the focus of attention (Experiment 2) were encoded and bidirectionally interacted with subsequent perception. These results suggest obligatory processing of summary statistics of a scene, which may allow rich and stable visual experience by integrating temporally adjacent visual inputs.