Gradient descent learning algorithm for hierarchical neural networks: A case study in industrial quality

被引:0
|
作者
Baratta, D [1 ]
Diotalevi, F [1 ]
Valle, M [1 ]
Caviglia, DD [1 ]
机构
[1] Univ Genoa, Dept Biophys & Elect Engn, I-16145 Genoa, Italy
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper deals with the training procedure for a hierarchical neural network (Tree of Multi-Layer Perceptrons - TMLP) aimed to classify surface defects in flat rolled strips. Due to the difficulties in collecting large Data Bases it is necessary to exploit at the best the available knowledge. A comparison between techniques derived from both the Back-Propagation and Weight-Perturbation algorithms is done, and experimental results are reported.
引用
收藏
页码:578 / 587
页数:10
相关论文
共 50 条
  • [41] Fractional-order gradient descent learning of BP neural networks with Caputo derivative
    Wang, Jian
    Wen, Yanqing
    Gou, Yida
    Ye, Zhenyun
    Chen, Hua
    NEURAL NETWORKS, 2017, 89 : 19 - 30
  • [42] Impact of Mathematical Norms on Convergence of Gradient Descent Algorithms for Deep Neural Networks Learning
    Cai, Linzhe
    Yu, Xinghuo
    Li, Chaojie
    Eberhard, Andrew
    Lien Thuy Nguyen
    Chuong Thai Doan
    AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 131 - 144
  • [43] An approximate gradient descent algorithm for Spiking Neural Network
    Chen, Wenjie
    Li, Chuandong
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4690 - 4694
  • [44] Theoretical analysis of batch and on-line training for gradient descent learning in neural networks
    Nakama, Takehiko
    NEUROCOMPUTING, 2009, 73 (1-3) : 151 - 159
  • [45] Using Particle Swarm Optimization with Gradient Descent for Parameter Learning in Convolutional Neural Networks
    Wessels, Steven
    van der Haar, Dustin
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2021, 2021, 12702 : 119 - 128
  • [46] Fast batch gradient descent in quantum neural networks
    Shim, Joo Yong
    Kim, Joongheon
    ELECTRONICS LETTERS, 2025, 61 (01)
  • [47] A Convergence Analysis of Gradient Descent on Graph Neural Networks
    Awasthi, Pranjal
    Das, Abhimanyu
    Gollapudi, Sreenivas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [48] Calibrated Stochastic Gradient Descent for Convolutional Neural Networks
    Zhuo, Li'an
    Zhang, Baochang
    Chen, Chen
    Ye, Qixiang
    Liu, Jianzhuang
    Doermann, David
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9348 - 9355
  • [49] Analysis of natural gradient descent for multilayer neural networks
    Rattray, M
    Saad, D
    PHYSICAL REVIEW E, 1999, 59 (04): : 4523 - 4532
  • [50] Generalization Guarantees of Gradient Descent for Shallow Neural Networks
    Wang, Puyu
    Lei, Yunwen
    Wang, Di
    Ying, Yiming
    Zhou, Ding-Xuan
    NEURAL COMPUTATION, 2025, 37 (02) : 344 - 402