Deep and Shallow Architecture of Multilayer Neural Networks

被引：59
作者：
Chang, Chih-Hung [1 ]
机构：
[1] Natl Univ Kaohsiung, Dept Appl Math, Kaohsiung 81148, Taiwan
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS | 2015年 / 26卷 / 10期
关键词：
Deep architecture; factor-like matrix; multilayer neural networks (MNNs); sofic shift; topological entropy; PATTERN-FORMATION; ALGORITHM;
D O I：
10.1109/TNNLS.2014.2387439
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper focuses on the deep and shallow architecture of multilayer neural networks (MNNs). The demonstration of whether or not an MNN can be replaced by another MNN with fewer layers is equivalent to studying the topological conjugacy of its hidden layers. This paper provides a systematic methodology to indicate when two hidden spaces are topologically conjugated. Furthermore, some criteria are presented for some specific cases.
引用
收藏
页码：2477 / 2486
页数：10
相关论文
共 41 条
[11]  
Cai D, 2006, COMMUN MATH SCI, V4, P97
[12]   FUZZY ARTMAP - A NEURAL NETWORK ARCHITECTURE FOR INCREMENTAL SUPERVISED LEARNING OF ANALOG MULTIDIMENSIONAL MAPS [J].
CARPENTER, GA ;
GROSSBERG, S ;
MARKUZON, N ;
REYNOLDS, JH ;
ROSEN, DB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (05) :698-713
[13]   ARTMAP - SUPERVISED REAL-TIME LEARNING AND CLASSIFICATION OF NONSTATIONARY DATA BY A SELF-ORGANIZING NEURAL NETWORK [J].
CARPENTER, GA ;
GROSSBERG, S ;
REYNOLDS, JH .
NEURAL NETWORKS, 1991, 4 (05) :565-588
[14]  
Chua L. O., 2002, Cellular neural networks and visual computing: foundations and applications
[15]  
Chua L.O., 1998, CNN PARADIGM COMPLEX, V31
[16]   CELLULAR NEURAL NETWORKS - THEORY [J].
CHUA, LO ;
YANG, L .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1988, 35 (10) :1257-1272
[17]   ABSOLUTE STABILITY OF GLOBAL PATTERN-FORMATION AND PARALLEL MEMORY STORAGE BY COMPETITIVE NEURAL NETWORKS [J].
COHEN, MA ;
GROSSBERG, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :815-826
[18]   Waves, bumps, and patterns in neural field theories [J].
Coombes, S .
BIOLOGICAL CYBERNETICS, 2005, 93 (02) :91-108
[19]   Evans functions for integral neural field equations with heaviside firing rate function [J].
Coombes, S ;
Owen, MR .
SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS, 2004, 3 (04) :574-600
[20]   METHODS FOR IMAGE-PROCESSING AND PATTERN-FORMATION IN CELLULAR NEURAL NETWORKS - A TUTORIAL [J].
CROUNSE, KR ;
CHUA, LO .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1995, 42 (10) :583-601
12345