Neural networks with hybrid morphological/rank/linear nodes: a unifying framework with applications to handwritten character recognition

被引:91
作者
Pessoa, LFC
Maragos, P
机构
[1] Motorola Inc, Austin, TX 78721 USA
[2] Natl Tech Univ Athens, Dept Elect & Comp Engn, GR-15773 Zografos, Athens, Greece
基金
美国国家科学基金会;
关键词
morphological systems; MRL-filters; neural networks; back-propagation algorithm; handwritten character recognition;
D O I
10.1016/S0031-3203(99)00157-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, the general class of morphological/rank/linear (MRL) multilayer feed-forward neural networks (NNs) is presented as a unifying signal processing tool that incorporates the properties of multilayer perceptrons (MLPs) and morphological/rank neural networks (MRNNs). The fundamental processing unit of MRL-NNs is the MRL-filter, where the combination of inputs in every node is formed by hybrid linear and nonlinear (of the morphological/rank type) operations. For its design we formulate a methodology using ideas from the back-propagation algorithm and robust techniques to circumvent the non-differentiability of rank functions. Extensive experimental results are presented from the problem of handwritten character recognition, which suggest that MRL-NNs not only provide better or similar performance when compared to MLPs but also can be trained faster. The MRL-NNs are a broad interesting class of nonlinear systems with many promising applications in pattern recognition and signal/image processing. (C) 2000 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:945 / 960
页数:16
相关论文
共 16 条
  • [1] GARRIS MD, 1997, 5959 NISTIR NAT I ST
  • [2] GARRIS MD, 1994, 5469 NISTIR NAT I ST
  • [3] Jolliffe I., 2002, PRINCIPAL COMPONENT, DOI [DOI 10.1016/0169-7439(87)80084-9, 10.1007/0-387-22440-8_13, DOI 10.1007/0-387-22440-8_13]
  • [4] A UNIFIED FRAMEWORK FOR GRADIENT ALGORITHMS USED FOR FILTER ADAPTATION AND NEURAL NETWORK TRAINING
    MARCOS, S
    MACCHI, O
    VIGNAT, C
    DREYFUS, G
    PERSONNAZ, L
    ROUSSELRAGOT, P
    [J]. INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 1992, 20 (02) : 159 - 200
  • [5] NEUROCOMPUTATIONS IN RELATIONAL SYSTEMS
    PEDRYCZ, W
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1991, 13 (03) : 289 - 297
  • [6] MRL-filters: A general class of nonlinear systems and their optimal design for image processing
    Pessoa, LFC
    Maragos, P
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (07) : 966 - 978
  • [7] PESSOA LFC, 1997, THESIS GEORGIA I TEC
  • [8] PESSOA LFC, 1996, P IEEE INT C AC SPEE, V6, P3399
  • [9] PRECHLET L, 1994, 2194 U KARLSR
  • [10] Rumelhart D.E., 1986, Learning internal representations by error propagation, DOI [10.1016/b978-1-4832-1446-7.50035-2, DOI 10.7551/MITPRESS/5236.001.0001]