Border Pairs Method-constructive MLP learning classification algorithm

被引:9
|
作者
Ploj, Bojan [1 ]
Harb, Robert [1 ]
Zorman, Milan [2 ]
机构
[1] Higher Vocat Coll, Sch Ctr Ptuj, SI-2250 Ptuj, Slovenia
[2] Univ Maribor, Fac Elect Engn & Comp Sci, SI-2000 Maribor, Slovenia
关键词
Artificial intelligence; Machine learning; Algorithm; Multi layer perceptron; Constructive neural network; Border pairs method;
D O I
10.1016/j.neucom.2013.03.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present the Border Pairs Method, a constructive learning algorithm for multilayer perceptron (MLP). During learning with this method a near-minimal network architecture is found. MLP learning is conducted separately by individual layers and neurons. The algorithm is tested in computer simulation with simple learning patterns (XOR and triangles image), with traditional learning patterns (Iris and Pen-Based Recognition of Handwritten Digits) and with noisy learning patterns. During the learning process we observed the following behaviour of BPM: capability to focus on global minima, good generalisation, no problems in learning with noisy, multi-dimensional and numerous learning patterns. The Border Pairs Method also supports incremental and online learning. Both are realized with or without MLP reconstruction and with or without forgetting (unlearning). The learning results with the BPM method are comparable with results from other methods. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:180 / 187
页数:8
相关论文
共 50 条
  • [21] Brain Tumor Classification Using Back Propagation Algorithm in MLP
    Achkar, Roger
    Owayjan, Michel
    Harajli, Batoul
    Khazaal, Daniel
    Dbouk, Mohammad
    Magnifico, Giuditta
    2019 FOURTH INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTATIONAL TOOLS FOR ENGINEERING APPLICATIONS (ACTEA), 2019,
  • [22] AN ONLINE LEARNING ALGORITHM FOR THE ORTHOGONAL WEIGHT ESTIMATION OF MLP
    PICAN, N
    FORT, JC
    ALEXANDRE, F
    NEURAL PROCESSING LETTERS, 1994, 1 (01) : 21 - 24
  • [23] Pruning strategies for the MTiling constructive learning algorithm
    Parekh, R
    Yang, JH
    Honavar, V
    1997 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, 1997, : 1960 - 1965
  • [24] A constructive learning algorithm for discriminant tangent models
    Sona, D
    Sperduti, A
    Starita, A
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 786 - 792
  • [25] A Novel PSO Based Back Propagation Learning-MLP (PSO-BP-MLP) for Classification
    Das, Himansu
    Jena, Ajay Kumar
    Nayak, Janmenjoy
    Naik, Bighnaraj
    Behera, H. S.
    COMPUTATIONAL INTELLIGENCE IN DATA MINING, VOL 2, 2015, 32 : 461 - 471
  • [26] An Improved PSO Based Back Propagation Learning-MLP (IPSO-BP-MLP) for Classification
    Kanungo, D. P.
    Naik, Bighnaraj
    Nayak, Janmenjoy
    Baboo, Sarada
    Behera, H. S.
    COMPUTATIONAL INTELLIGENCE IN DATA MINING, VOL 1, 2015, 31 : 333 - 344
  • [27] Efficient MLP constructive training algorithm using a neuron recruiting approach for isolated word recognition system
    Masmoudi S.
    Frikha M.
    Chtourou M.
    Hamida A.B.
    International Journal of Speech Technology, 2011, 14 (1) : 1 - 10
  • [28] MLP neural network using constructive training algorithm: Application to face recognition and facial expression recognition
    Boughrara H.
    Chtourou M.
    Amar C.B.
    Boughrara, Hayet (hayet.boughrara@laposte.net), 1600, Inderscience Enterprises Ltd., 29, route de Pre-Bois, Case Postale 856, CH-1215 Geneva 15, CH-1215, Switzerland (16): : 53 - 79
  • [29] Discretization Techniques and Genetic Algorithm for Learning the Classification Method PROAFTN
    Al-Obeidat, Feras
    Belacel, Nabil
    Mahanti, Prabhat
    Carretero, Juan A.
    EIGHTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2009, : 685 - +
  • [30] A Constructive Data Classification Version of the Particle Swarm Optimization Algorithm
    Szabo, Alexandre
    de Castro, Leandro Nunes
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013