FAST NON-NEGATIVE LEAST-SQUARES LEARNING IN THE RANDOM NEURAL NETWORK

被引:3
|
作者
Timotheou, Stelios [1 ]
机构
[1] Univ Cyprus, KIOS Res Ctr Intelligent Syst & Networks, CY-1678 Nicosia, Cyprus
关键词
INITIALIZATION; ASSIGNMENT; HEURISTICS; ALGORITHM;
D O I
10.1017/S0269964816000061
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The random neural network is a biologically inspired neural model where neurons interact by probabilistically exchanging positive and negative unit-amplitude signals that has superior learning capabilities compared to other artificial neural networks. This paper considers non-negative least squares supervised learning in this context, and develops an approach that achieves fast execution and excellent learning capacity. This speedup is a result of significant enhancements in the solution of the non-negative least-squares problem which regard (a) the development of analytical expressions for the evaluation of the gradient and objective functions and (b) a novel limited-memory quasi-Newton solution algorithm. Simulation results in the context of optimizing the performance of a disaster management problem using supervised learning verify the efficiency of the approach, achieving two orders of magnitude execution speedup and improved solution quality compared to state-of-the-art algorithms.
引用
收藏
页码:379 / 402
页数:24
相关论文
共 50 条
  • [31] FAST LEARNING-PROCESS OF MULTILAYER NEURAL NETWORKS USING RECURSIVE LEAST-SQUARES METHOD
    AZIMISADJADI, MR
    LIOU, RJ
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (02) : 446 - 450
  • [32] Convolutional Neural Network-Assisted Least-Squares Migration
    Wu, Boming
    Hu, Hao
    Zhou, Hua-Wei
    SURVEYS IN GEOPHYSICS, 2023, 44 (04) : 1107 - 1124
  • [33] Deep convolutional neural network and sparse least-squares migration
    Liu Z.
    Chen Y.
    Schuster G.
    Geophysics, 2020, 85 (04): : WA241 - WA253
  • [34] A Neural Network for Weighted Least-Squares Criteria of Traveltime Tomography
    Ma Ning
    Hu Zhengyi
    Wang YanpjngCollege of Electronic InformationWuhan UniversityWuhan China
    Wuhan University Journal of Natural Sciences, 1996, (02)
  • [35] Linear least-squares based methods for neural networks learning
    Fontenla-Romero, O
    Erdogmus, D
    Principe, JC
    Alonso-Betanzos, A
    Castillo, E
    ARTIFICAIL NEURAL NETWORKS AND NEURAL INFORMATION PROCESSING - ICAN/ICONIP 2003, 2003, 2714 : 84 - 91
  • [36] Mixture analysis using reverse searching and non-negative least squares
    Zhang, Zhi-Min
    Chen, Xiao-Qing
    Lu, Hong-Mei
    Liang, Yi-Zeng
    Fan, Wei
    Xu, Deng
    Zhou, Jack
    Ye, Fei
    Yang, Zheng-Yu
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2014, 137 : 10 - 20
  • [37] Cancelable fingerprint template design with randomized non-negative least squares
    Kho, Jun Beom
    Kim, Jaihie
    Kim, Ig-Jae
    Teoh, Andrew B. J.
    PATTERN RECOGNITION, 2019, 91 : 245 - 260
  • [38] Non-negative Pyramidal Neural Network for Parts-based Learning
    Ferro, Milla S. A.
    Fernandes, Bruno J. T.
    Bastos-Filho, Carmelo J. A.
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1709 - 1716
  • [39] A unified framework for sparse non-negative least squares using multiplicative updates and the non-negative matrix factorization problem
    Fedorov, Igor
    Nalci, Alican
    Giri, Ritwik
    Rao, Bhaskar D.
    Nguyen, Truong Q.
    Garudadri, Harinath
    SIGNAL PROCESSING, 2018, 146 : 79 - 91
  • [40] CONVERGENCE ANALYSIS OF WEIGHTED LEAST-SQUARES AND FAST DECOUPLED WEIGHTED LEAST-SQUARES STATE ESTIMATION
    SIRISENA, HR
    BROWN, EPM
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 1984, 6 (02) : 75 - 78