Capability measures of artificial neural network architectures based on soft shattering

被引:0
作者
Oxley, ME [1 ]
Carter, MA [1 ]
机构
[1] USAF, Inst Technol, Dept Math & Stat, Wright Patterson AFB, OH 45433 USA
来源
APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE IV | 2001年 / 4390卷
关键词
artificial neural network; capability measure; V-C dimension; soft shattering;
D O I
10.1117/12.421183
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Measures of an artificial neural network (ANN) capability are tyically based on the Vapnik-Chernonvekis dimension and its variations. These measures may be underestimating the actual ANN's capabilities and hence overestimating the required number of examples for learning. This is caused by relying on a single invariant description of the problem set, which, in this case is cardinality, and requiring worst case geometric arrangements and colorings. A capability measure of an ANN is (usually) related to the desired characteristics of the problem sets. The mathematical framework has been established in which to express other desired invariant descriptors of a capability measure (e.g., V-C dimension uses cardinality). A new invariants is defined on the problem space that softens the (hard) shattering constraint and yields a new capability measure of ANNs. The theory is given as well as examples that demostrate this new measure.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 9 条
  • [1] Barnsley M. F., 2014, Fractals Everywhere
  • [2] Generalized measures of artificial neural network capabilities
    Carter, MA
    Oxley, ME
    [J]. APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE II, 1999, 3722 : 36 - 47
  • [3] CARTER MA, 1995, AFITDSENC95J01
  • [4] Halmos Paul R., 1950, Measure Theory, DOI DOI 10.1007/978-1-4684-9440-2
  • [5] Naylor A. W., 1982, LINEAR OPERATOR THEO
  • [6] OXLEY ME, 2000, SPIE, V4055, P1
  • [7] FEEDFORWARD NETS FOR INTERPOLATION AND CLASSIFICATION
    SONTAG, ED
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1992, 45 (01) : 20 - 48
  • [8] UNIFORM CONVERGENCE OF RELATIVE FREQUENCIES OF EVENTS TO THEIR PROBABILITIES
    VAPNIK, VN
    CHERVONENKIS, AY
    [J]. THEORY OF PROBILITY AND ITS APPLICATIONS,USSR, 1971, 16 (02): : 264 - +
  • [9] SOME SPECIAL VAPNIK-CHERVONENKIS CLASSES
    WENOCUR, RS
    DUDLEY, RM
    [J]. DISCRETE MATHEMATICS, 1981, 33 (03) : 313 - 318