Deep and Shallow Architecture of Multilayer Neural Networks

被引：59
作者：
Chang, Chih-Hung [1 ]
机构：
[1] Natl Univ Kaohsiung, Dept Appl Math, Kaohsiung 81148, Taiwan
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS | 2015年 / 26卷 / 10期
关键词：
Deep architecture; factor-like matrix; multilayer neural networks (MNNs); sofic shift; topological entropy; PATTERN-FORMATION; ALGORITHM;
D O I：
10.1109/TNNLS.2014.2387439
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper focuses on the deep and shallow architecture of multilayer neural networks (MNNs). The demonstration of whether or not an MNN can be replaced by another MNN with fewer layers is equivalent to studying the topological conjugacy of its hidden layers. This paper provides a systematic methodology to indicate when two hidden spaces are topologically conjugated. Furthermore, some criteria are presented for some specific cases.
引用
收藏
页码：2477 / 2486
页数：10
相关论文
共 41 条
[1]   Pattern recognition using multilayer neural-genetic algorithm [J].
Alsultanny, YA ;
Aqel, MM .
NEUROCOMPUTING, 2003, 51 :237-247
[2]  
[Anonymous], LARGE SCALE KERNEL M
[3]   A CNN algorithm for real time analysis of DNA microarrays [J].
Arena, P ;
Fortuna, L ;
Occhipinti, L .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 2002, 49 (03) :335-340
[4]   Self-organization in a two-layer CNN [J].
Arena, P ;
Baglio, S ;
Fortuna, L ;
Manganaro, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1998, 45 (02) :157-162
[5]   A CNN framework for modeling parallel processing in a mammalian retina [J].
Bálya, D ;
Roska, B ;
Roska, T ;
Werblin, FS .
INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2002, 30 (2-3) :363-393
[6]   The learning problem of multi-layer neural networks [J].
Ban, Jung-Chao ;
Chang, Chih-Hung .
NEURAL NETWORKS, 2013, 46 :116-123
[7]   On the structure of multi-layer cellular neural networks [J].
Ban, Jung-Chao ;
Chang, Chih-Hung ;
Lin, Song-Sun .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2012, 252 (08) :4563-4597
[8]   Spatial complexity in multi-layer cellular neural networks [J].
Ban, Jung-Chao ;
Chang, Chih-Hung ;
Lin, Song-Sun ;
Lin, Yin-Heng .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2009, 246 (02) :552-580
[9]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[10]   Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex [J].
Bressloff, PC ;
Cowan, JD ;
Golubitsky, M ;
Thomas, PJ ;
Wiener, MC .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2001, 356 (1407) :299-330
12345