Quantizability and learning complexity in multilayer neural networks

被引:1
|
作者
Fu, LM [1 ]
机构
[1] Univ Florida, Dept Comp & Informat Sci, Gainesville, FL 32611 USA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS | 1998年 / 28卷 / 02期
基金
美国国家科学基金会;
关键词
generalization; learning complexity; machine learning; neural network; quantizability; sample complexity;
D O I
10.1109/5326.669575
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The relationship between quantizability and learning complexity in multilayer neural networks is examined. In a special neural network architecture that calculates node activations according to the certainty factor (CF) model of expert systems, the analysis based upon quantizability leads to lower and also better estimates for generalization dimensionality and sample complexity than those suggested by the multilayer perceptron model. This analysis is further supported by empirical simulation results.
引用
收藏
页码:295 / 300
页数:6
相关论文
共 50 条
  • [1] Learning in certainty-factor-based multilayer neural networks for classification
    Fu, LM
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (01): : 151 - 158
  • [2] On the Computational Complexity of Learning Bithreshold Neural Units and Networks
    Kotsovsky, Vladyslav
    Geche, Fedir
    Batyuk, Anatoliy
    LECTURE NOTES IN COMPUTATIONAL INTELLIGENCE AND DECISION MAKING, 2020, 1020 : 189 - 202
  • [4] Complexity matching in neural networks
    Mafahim, Javad Usefie
    Lambert, David
    Zare, Marzieh
    Grigolini, Paolo
    NEW JOURNAL OF PHYSICS, 2015, 17
  • [5] A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses
    Adhikari, Shyam Prasad
    Kim, Hyongsuk
    Budhathoki, Ram Kaji
    Yang, Changju
    Chua, Leon O.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2015, 62 (01) : 215 - 223
  • [6] Lyapunov exponent analysis for multilayer neural networks
    Kondo, Misaki
    Sunada, Satoshi
    Niiyama, Tomoaki
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2021, 12 (04): : 674 - 684
  • [7] General memristor with applications in multilayer neural networks
    Wen, Shiping
    Xie, Xudong
    Yan, Zheng
    Huang, Tingwen
    Zeng, Zhigang
    NEURAL NETWORKS, 2018, 103 : 142 - 149
  • [8] Deep Learning with Dense Random Neural Networks
    Gelenbe, Erol
    Yin, Yonghua
    MAN-MACHINE INTERACTIONS 5, ICMMI 2017, 2018, 659 : 3 - 18
  • [9] Acoustic plane-wave decomposition by means of multilayer perceptron neural networks
    Sack, Stefan
    Abom, Mats
    JOURNAL OF SOUND AND VIBRATION, 2020, 486 (486)
  • [10] Dropout Rademacher complexity of deep neural networks
    Gao, Wei
    Zhou, Zhi-Hua
    SCIENCE CHINA-INFORMATION SCIENCES, 2016, 59 (07)