Deep learning and the Global Workspace Theory

被引:37
作者
VanRullen, Rufin [1 ,2 ]
Kanai, Ryota [3 ]
机构
[1] CNRS UMR5549, Brain & Cognit Res Ctr CerCo, Toulouse, France
[2] Univ Toulouse, Artificial & Nat Intelligence Toulouse Inst ANITI, Toulouse, France
[3] Araya Inc, Tokyo, Japan
基金
日本科学技术振兴机构;
关键词
INTEGRATED INFORMATION; COGNITIVE ARCHITECTURE; NEURONAL MODEL; CONSCIOUSNESS; ATTENTION; FRAMEWORK; MECHANISMS; ACCESS;
D O I
10.1016/j.tins.2021.04.005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Recent advances in deep learning have allowed artificial intelligence (AI) to reach near human-level performance in many sensory, perceptual, linguistic, and cognitive tasks. There is a growing need, however, for novel, brain-inspired cognitive architectures. The Global Workspace Theory (GWT) refers to a large-scale system integrating and distributing information among networks of specialized modules to create higher-level forms of cognition and awareness. We argue that the time is ripe to consider explicit implementations of this theory using deep-learning techniques. We propose a roadmap based on unsupervised neural translation between multiple latent spaces (neural networks trained for distinct tasks, on distinct sensory inputs and/or modalities) to create a unique, amodal Global Latent Workspace (GLW). Potential functional advantages of GLW are reviewed, along with neuroscientific implications.
引用
收藏
页码:692 / 704
页数:13
相关论文
共 96 条
[1]   TASK2VEC: Task Embedding for Meta-Learning [J].
Achille, Alessandro ;
Lam, Michael ;
Tewari, Rahul ;
Ravichandran, Avinash ;
Maji, Subhransu ;
Fowlkes, Charless ;
Soatto, Stefano ;
Perona, Pietro .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6439-6448
[2]   Alpha oscillations and traveling waves: Signatures of predictive coding? [J].
Alamia, Andrea ;
VanRullen, Rufin .
PLOS BIOLOGY, 2019, 17 (10)
[3]  
[Anonymous], 2011, Thinking, DOI [DOI 10.1037/H0099210, 10.1037/h0099210]
[4]  
Artetxe Mikel., 2018, ARXIV
[5]  
Baars B. J., 1993, COGNITIVE THEORY CON
[6]   Global workspace theory of consciousness: toward a cognitive neuroscience of human experience [J].
Baars, BJ .
BOUNDARIES OF CONSCIOUSNESS: NEUROBIOLOGY AND NEUROPATHOLOGY, 2005, 150 :45-53
[7]   Canonical Microcircuits for Predictive Coding [J].
Bastos, Andre M. ;
Usrey, W. Martin ;
Adams, Rick A. ;
Mangun, George R. ;
Fries, Pascal ;
Friston, Karl J. .
NEURON, 2012, 76 (04) :695-711
[8]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[9]  
Bengio Y., 2017, arXiv
[10]   ON A CONFUSION ABOUT A FUNCTION OF CONSCIOUSNESS [J].
BLOCK, N .
BEHAVIORAL AND BRAIN SCIENCES, 1995, 18 (02) :227-247