Parallel implementation of the feedforward back-propagation algorithm on pyramid networks

被引：0
|
作者：
Maelainin, SA
Bellaachia, A
机构：
来源：
PARALLEL AND DISTRIBUTED COMPUTING SYSTEMS - PROCEEDINGS OF THE ISCA 9TH INTERNATIONAL CONFERENCE, VOLS I AND II | 1996年
关键词：
pyramid; interconnection networks; neural networks; backpropagation; feedforward; hopfield network;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this paper, we present a parallel implementation of the FeedForward BackPropagation algorithm on pyramids. The proposed algorithm is quite simple and easy to implement. For an ANN of L layers and a maximum of N nodes per layer, our algorithm requires a pyramid of (4N(2)-1)/3 processors to perform backpropagation algorithm in O(LN) time complexity. Note that our solution requires less than the number of nodes required by the best known solution for a mesh of appendixed trees topology of 3N(2) processors. In addition, the algorithm can be adapted to quadtrees with slight modifications. The technique used in our implementation can also be applied to the Hopfield network.
引用
收藏
页码：444 / 449
页数：6
相关论文
共 50 条
  • [31] STOCHASTIC GPU-BASED MULTITHREAD IMPLEMENTATION OF MULTIPLE BACK-PROPAGATION
    Lopes, Noel
    Ribeiro, Bernardete
    ICAART 2010: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 1: ARTIFICIAL INTELLIGENCE, 2010, : 271 - 276
  • [32] Hybrid back-propagation training with evolutionary strategies
    José Parra
    Leonardo Trujillo
    Patricia Melin
    Soft Computing, 2014, 18 : 1603 - 1614
  • [33] Hybrid back-propagation training with evolutionary strategies
    Parra, Jose
    Trujillo, Leonardo
    Melin, Patricia
    SOFT COMPUTING, 2014, 18 (08) : 1603 - 1614
  • [34] THE GENERALIZED PROPORTIONAL-INTEGRAL-DERIVATIVE (PID) GRADIENT DESCENT BACK-PROPAGATION ALGORITHM
    VITTHAL, R
    SUNTHAR, P
    RAO, CD
    NEURAL NETWORKS, 1995, 8 (04) : 563 - 569
  • [35] Multi-output incremental back-propagation
    Chaudhari, Rachana
    Agarwal, Dhwani
    Ravishankar, Kritika
    Masand, Nikita
    Sambhe, Vijay K. K.
    Udmale, Sandeep S. S.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (20) : 14897 - 14910
  • [36] On the Local Hessian in Back-propagation
    Zhang, Huishuai
    Chen, Wei
    Liu, Tie-Yan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [37] CONVERGENCE OF BACK-PROPAGATION IN NEURAL NETWORKS USING A LOG-LIKELIHOOD COST FUNCTION
    HOLT, MJJ
    SEMNANI, S
    ELECTRONICS LETTERS, 1990, 26 (23) : 1964 - 1965
  • [38] An improved back-propagation neural networks using a modified non-linear function
    Otair, MA
    Salameh, WA
    Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, Vols 1and 2, 2004, : 442 - 447
  • [39] Pattern Classification of Back-Propagation Algorithm Using Exclusive Connecting Network
    Jung, Insung
    Wang, Gi-Nam
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 26, PARTS 1 AND 2, DECEMBER 2007, 2007, 26 : 666 - 670
  • [40] Based on Privacy Preserving for Back-propagation Neural Network Learning Algorithm
    Wang, Jian
    ADVANCED MATERIALS AND INFORMATION TECHNOLOGY PROCESSING, PTS 1-3, 2011, 271-273 : 857 - 862
12345