Texture and art with deep neural networks

被引:52
作者
Gatys, Leon A. [1 ,2 ,3 ,4 ]
Ecker, Alexander S. [1 ,2 ,3 ,6 ]
Bethge, Matthias [1 ,2 ,3 ,5 ]
机构
[1] Univ Tubingen, Werner Reichardt Ctr Integrat Neurosci, Tubingen, Germany
[2] Univ Tubingen, Inst Theoret Phys, Tubingen, Germany
[3] Bernstein Ctr Computat Neurosci, Tubingen, Germany
[4] Grad Sch Neural Informat Proc, Tubingen, Germany
[5] Max Planck Inst Biol Cybernet, Tubingen, Germany
[6] Baylor Coll Med, Dept Neurosci, Houston, TX 77030 USA
关键词
STATISTICS; RECOGNITION; MODEL;
D O I
10.1016/j.conb.2017.08.019
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Although the study of biological vision and computer vision attempt to understand powerful visual information processing from different angles, they have a long history of informing each other. Recent advances in texture synthesis that were motivated by visual neuroscience have led to a substantial advance in image synthesis and manipulation in computer vision using convolutional neural networks (CNNs). Here, we review these recent advances and discuss how they can in turn inspire new research in visual perception and computational neuroscience.
引用
收藏
页码:178 / 186
页数:9
相关论文
共 73 条
[51]   Metamers of the ventral stream [J].
Freeman, Jeremy ;
Simoncelli, Eero P. .
NATURE NEUROSCIENCE, 2011, 14 (09) :1195-U130
[53]  
Gatys LA, 2015, ADV NEUR IN, V28
[54]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[55]  
Heeger D. J., 1995, Computer Graphics Proceedings. SIGGRAPH 95, P229, DOI 10.1145/218380.218446
[56]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[57]   INABILITY OF HUMANS TO DISCRIMINATE BETWEEN VISUAL TEXTURES THAT AGREE IN SECOND-ORDER STATISTICS - REVISITED [J].
JULESZ, B ;
GILBERT, EN ;
SHEPP, LA ;
FRISCH, HL .
PERCEPTION, 1973, 2 (04) :391-405
[58]   VISUAL-DISCRIMINATION OF TEXTURES WITH IDENTICAL 3RD-ORDER STATISTICS [J].
JULESZ, B ;
GILBERT, EN ;
VICTOR, JD .
BIOLOGICAL CYBERNETICS, 1978, 31 (03) :137-140
[59]   A BRIEF OUTLINE OF THE TEXTON THEORY OF HUMAN-VISION [J].
JULESZ, B .
TRENDS IN NEUROSCIENCES, 1984, 7 (02) :41-45
[60]   Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation [J].
Khaligh-Razavi, Seyed-Mahdi ;
Kriegeskorte, Nikolaus .
PLOS COMPUTATIONAL BIOLOGY, 2014, 10 (11)