Gaussian Mixture Models Improve fMRI-based Image Reconstruction

被引:0
作者
Schoenmakers, Sanne [1 ,3 ]
van Gerven, Marcel
Heskes, Tom [2 ]
机构
[1] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Donders Ctr Cognit, POB 9104, NL-6500 HE Nijmegen, Netherlands
[2] Radboud Univ Nijmegen, Inst Comp & Informat Sci, NL-6500 HE Nijmegen, Netherlands
[3] Radboud Univ Nijmegen, Donders Ctr Cognit, Donders Inst Brain Cognit & Behaviour, NL-6500 HE Nijmegen, Netherlands
来源
2014 INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION IN NEUROIMAGING | 2014年
关键词
BRAIN; REPRESENTATIONS;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
New computational models have made it possible to reconstruct perceived images from BOLD responses in visual cortex. We expand a linear Gaussian framework for percept decoding with Gaussian mixture models to better represent the prior distribution of images. In our setup, different mixture components correspond to different letter categories. Our framework not only leads to more accurate reconstructions, but also automatically infers semantic categories from low-level visual areas of the human brain.
引用
收藏
页数:4
相关论文
共 12 条
[1]  
[Anonymous], 2006, Pattern recognition and machine learning
[2]   Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex [J].
Cox, DD ;
Savoy, RL .
NEUROIMAGE, 2003, 19 (02) :261-270
[3]   Interpretable whole-brain prediction analysis with GraphNet [J].
Grosenick, Logan ;
Klingenberg, Brad ;
Katovich, Kiefer ;
Knutson, Brian ;
Taylor, Jonathan E. .
NEUROIMAGE, 2013, 72 :304-321
[4]   Distributed and overlapping representations of faces and objects in ventral temporal cortex [J].
Haxby, JV ;
Gobbini, MI ;
Furey, ML ;
Ishai, A ;
Schouten, JL ;
Pietrini, P .
SCIENCE, 2001, 293 (5539) :2425-2430
[5]   Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey [J].
Kriegeskorte, Nikolaus ;
Mur, Marieke ;
Ruff, Douglas A. ;
Kiani, Roozbeh ;
Bodurka, Jerzy ;
Esteky, Hossein ;
Tanaka, Keiji ;
Bandettini, Peter A. .
NEURON, 2008, 60 (06) :1126-1141
[6]   Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders [J].
Miyawaki, Yoichi ;
Uchida, Hajime ;
Yamashita, Okito ;
Sato, Masa-aki ;
Morito, Yusuke ;
Tanabe, Hiroki C. ;
Sadato, Norihiro ;
Kamitani, Yukiyasu .
NEURON, 2008, 60 (05) :915-929
[7]   Bayesian Reconstruction of Natural Images from Human Brain Activity [J].
Naselaris, Thomas ;
Prenger, Ryan J. ;
Kay, Kendrick N. ;
Oliver, Michael ;
Gallant, Jack L. .
NEURON, 2009, 63 (06) :902-915
[8]   Linear reconstruction of perceived images from human brain activity [J].
Schoenmakers, Sanne ;
Barth, Markus ;
Heskes, Tom ;
van Gerven, Marcel .
NEUROIMAGE, 2013, 83 :951-961
[9]   Modality-Independent Decoding of Semantic Information from the Human Brain [J].
Simanova, Irina ;
Hagoort, Peter ;
Oostenveld, Robert ;
van Gerven, Marcel A. J. .
CEREBRAL CORTEX, 2014, 24 (02) :426-434
[10]   Reconstruction of natural scenes from ensemble responses in the lateral geniculate nucleus [J].
Stanley, GB ;
Li, FF ;
Dan, Y .
JOURNAL OF NEUROSCIENCE, 1999, 19 (18) :8036-8042