The Whitney Reduction Network: A method for computing autoassociative graphs

被引:29
作者
Broomhead, DS [1 ]
Kirby, MJ
机构
[1] Univ Manchester, Inst Sci & Technol, Dept Math, Manchester M60 1QD, Lancs, England
[2] Colorado State Univ, Dept Math, Ft Collins, CO 80523 USA
关键词
D O I
10.1162/089976601753196049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article introduces a new architecture and associated algorithms ideal for implementing the dimensionality reduction of an ni-dimensional manifold initially residing in an n-dimensional Euclidean space where n >> m. Motivated by Whitney's embedding theorem, the network is capable of training the identity mapping employing the idea of the graph of a function. In theory, a reduction to a dimension d that retains the differential structure of the original data may be achieved for some d less than or equal to 2m + 1. To implement this network, we propose the idea of a good-projection, which enhances the generalization capabilities of the network, and an adaptive secant basis algorithm to achieve it. The effect of noise on this procedure is also considered. The approach is illustrated with several examples.
引用
收藏
页码:2595 / 2616
页数:22
相关论文
共 12 条
  • [1] Atick JJ, 1996, NETWORK-COMP NEURAL, V7, P1, DOI [10.1088/0954-898X/7/1/002, 10.1080/0954898X.1996.11978652]
  • [2] Broomhead D. S., 1988, Complex Systems, V2, P321
  • [3] A new approach to dimensionality reduction: theory and algorithms
    Broomhead, DS
    Kirby, M
    [J]. SIAM JOURNAL ON APPLIED MATHEMATICS, 2000, 60 (06) : 2114 - 2142
  • [4] COTTRELL GW, 1991, ADV NEURAL INFORMATI, V3, P564
  • [5] KARHUNEN-LOEVE PROCEDURE FOR GAPPY DATA
    EVERSON, R
    SIROVICH, L
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1995, 12 (08): : 1657 - 1664
  • [6] Falconer K., 1990, FRACTAL GEOMETRY MAT, V2
  • [7] Guillemin V., 2010, DIFFERENTIAL TOPOLOG, V370
  • [8] Hirsch M. W., 1976, GraduateTexts inMathematics, V33
  • [9] APPLICATION OF THE KARHUNEN-LOEVE PROCEDURE FOR THE CHARACTERIZATION OF HUMAN FACES
    KIRBY, M
    SIROVICH, L
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (01) : 103 - 108
  • [10] Kirby M., 2001, Geometric Data Analysis: An empirical Approach to Dimensionality Reduction and the Study of Patterns, V31