A New Computational Approach to the Levenberg-Marquardt Learning Algorithm

被引:0
|
作者
Bilski, Jaroslaw [1 ]
Kowalczyk, Barosz [1 ]
Smolag, Jacek [1 ]
机构
[1] Czestochowa Tech Univ, Inst Computat Intelligence, Czestochowa, Poland
关键词
Neural network learning algorithm; Levenberg-marquardt learning algorithm; Vector computations; Approximation; Classification; NEURO-FUZZY SYSTEMS; PARALLEL REALIZATION; NONLINEAR REGRESSIONS; NETWORKS; IDENTIFICATION;
D O I
10.1007/978-3-031-23492-7_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new parallel computational approach to the Levenberg-Marquardt learning algorithm is presented. The proposed solution is based on the AVX instructions to effectively reduce the high computational load of this algorithm. Detailed parallel neural network computations are explicitly discussed. Additionally obtained acceleration is shown based on a few test problems.
引用
收藏
页码:16 / 26
页数:11
相关论文
共 50 条
  • [1] Adaptive Levenberg-Marquardt Algorithm: A New Optimization Strategy for Levenberg-Marquardt Neural Networks
    Yan, Zhiqi
    Zhong, Shisheng
    Lin, Lin
    Cui, Zhiquan
    MATHEMATICS, 2021, 9 (17)
  • [2] Parallel Approach to the Levenberg-Marquardt Learning Algorithm for Feedforward Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    Zurada, Jacek M.
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, PT I, 2015, 9119 : 3 - 14
  • [3] A Parallel Levenberg-Marquardt Algorithm
    Cao, Jun
    Novstrup, Krista A.
    Goyal, Ayush
    Midkiff, Samuel R.
    Caruthers, James M.
    ICS'09: PROCEEDINGS OF THE 2009 ACM SIGARCH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, 2009, : 450 - 459
  • [4] An Online Actor-Critic Learning Approach with Levenberg-Marquardt Algorithm
    Ni, Zhen
    He, Haibo
    Prokhorov, Danil V.
    Fu, Jian
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 2333 - 2340
  • [5] Fast Computational Approach to the Levenberg-Marquardt Algorithm for Training Feedforward Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    Kowalczyk, Bartosz
    Grzanek, Konrad
    Izonin, Ivan
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2023, 13 (02) : 45 - 61
  • [6] A New Levenberg-Marquardt Algorithm for feedforward neural networks
    Li, Yanlai
    Wang, Kuanquan
    Li, Tao
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3516 - 3519
  • [7] The Parallel Modification to the Levenberg-Marquardt Algorithm
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Grzanek, Konrad
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 15 - 24
  • [8] A New Robust Correntropy Based Levenberg-Marquardt Algorithm
    Heravi, Ahmad Reza
    Hodtani, Ghosheh Abed
    2016 IRAN WORKSHOP ON COMMUNICATION AND INFORMATION THEORY (IWCIT), 2016,
  • [9] The application and modeling of the Levenberg-Marquardt algorithm
    Li, Jian-rong
    2010 2ND INTERNATIONAL CONFERENCE ON E-BUSINESS AND INFORMATION SYSTEM SECURITY (EBISS 2010), 2010, : 278 - 280
  • [10] LOCAL LEVENBERG-MARQUARDT ALGORITHM FOR LEARNING FEEDFORWAD NEURAL NETWORKS
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Marchlewska, Alina
    Zurada, Jacek M.
    JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2020, 10 (04) : 299 - 316