Deep and Shallow Architecture of Multilayer Neural Networks

被引：59

作者：

Chang, Chih-Hung ^{[1
]}

机构：

[1] Natl Univ Kaohsiung, Dept Appl Math, Kaohsiung 81148, Taiwan

来源：

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS | 2015年 / 26卷 / 10期

关键词：

Deep architecture; factor-like matrix; multilayer neural networks (MNNs); sofic shift; topological entropy; PATTERN-FORMATION; ALGORITHM;

D O I：

10.1109/TNNLS.2014.2387439

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper focuses on the deep and shallow architecture of multilayer neural networks (MNNs). The demonstration of whether or not an MNN can be replaced by another MNN with fewer layers is equivalent to studying the topological conjugacy of its hidden layers. This paper provides a systematic methodology to indicate when two hidden spaces are topologically conjugated. Furthermore, some criteria are presented for some specific cases.

引用

页码：2477 / 2486

页数：10

共 50 条

[21] Shallow Versus Deep Neural Networks in Gear Fault Diagnosis
Cirrincione, Giansalvo
Kumar, Rahul Ranjeev
Mohammadi, Ali
Kia, Shahin Hedayati
Barbiero, Pietro
Ferretti, Jacopo
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2020, 35 (03) : 1338 - 1347
[22] A systematic review on overfitting control in shallow and deep neural networks
Mohammad Mahdi Bejani
Mehdi Ghatee
Artificial Intelligence Review, 2021, 54 : 6391 - 6438
[23] Efficient architecture for deep neural networks with heterogeneous sensitivity
Cho, Hyunjoong
Jang, Jinhyeok
Lee, Chanhyeok
Yang, Seungjoon
NEURAL NETWORKS, 2021, 134 : 95 - 106
[24] Learning deep morphological networks with neural architecture search
Hu, Yufei
Belkhir, Nacim
Angulo, Jesus
Yao, Angela
Franchi, Gianni
PATTERN RECOGNITION, 2022, 131
[25] A Fast Compressed Hardware Architecture for Deep Neural Networks
Ansari, Anaam
Shelton, Allen
Ogunfunmi, Tokunbo
Panchbhaiyye, Vineet
2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 370 - 374
[26] A Domain-Specific Architecture for Deep Neural Networks
Jouppi, Norman P.
Young, Cliff
Patil, Nishant
Patterson, David
COMMUNICATIONS OF THE ACM, 2018, 61 (09) : 50 - 59
[27] NeuroUnlock: Unlocking the Architecture of Obfuscated Deep Neural Networks
Ahmadi, Mahya Morid
Alrahis, Lilas
Colucci, Alessio
Sinanoglu, Ozgur
Shafique, Muhammad
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[28] Efficient Softmax Hardware Architecture for Deep Neural Networks
Du, Gaoming
Tian, Chao
Li, Zhenmin
Zhang, Duoli
Yin, Yongsheng
Ouyang, Yiming
GLSVLSI '19 - PROCEEDINGS OF THE 2019 ON GREAT LAKES SYMPOSIUM ON VLSI, 2019, : 75 - 80
[29] An efficient scalable parallel hardware architecture for multilayer spiking neural networks
Nuno-Maganda, Marco Aurelio
Arias-Estrada, Miguel
Torres-Huitzil, Cesar
2007 3RD SOUTHERN CONFERENCE ON PROGRAMMABLE LOGIC, PROCEEDINGS, 2007, : 167 - +
[30] A mixture of shallow neural networks for virtual sensing: Could perform better than deep neural networks
Shao, Weiming
Li, Xu
Xing, Yupeng
Chen, Junghui
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 256

← 1 2 3 4 5 →