FAST NON-NEGATIVE LEAST-SQUARES LEARNING IN THE RANDOM NEURAL NETWORK

被引:3
|
作者
Timotheou, Stelios [1 ]
机构
[1] Univ Cyprus, KIOS Res Ctr Intelligent Syst & Networks, CY-1678 Nicosia, Cyprus
关键词
INITIALIZATION; ASSIGNMENT; HEURISTICS; ALGORITHM;
D O I
10.1017/S0269964816000061
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The random neural network is a biologically inspired neural model where neurons interact by probabilistically exchanging positive and negative unit-amplitude signals that has superior learning capabilities compared to other artificial neural networks. This paper considers non-negative least squares supervised learning in this context, and develops an approach that achieves fast execution and excellent learning capacity. This speedup is a result of significant enhancements in the solution of the non-negative least-squares problem which regard (a) the development of analytical expressions for the evaluation of the gradient and objective functions and (b) a novel limited-memory quasi-Newton solution algorithm. Simulation results in the context of optimizing the performance of a disaster management problem using supervised learning verify the efficiency of the approach, achieving two orders of magnitude execution speedup and improved solution quality compared to state-of-the-art algorithms.
引用
收藏
页码:379 / 402
页数:24
相关论文
共 50 条
  • [11] Non-negative Autoencoder with Simplified Random Neural Network
    Yin, Yonghua
    Gelenbe, Erol
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [12] Research on the fast algorithm for hierarchic least squares of non-negative matrix factorization
    Xin, Huang
    Journal of Convergence Information Technology, 2012, 7 (11) : 359 - 368
  • [13] Non-negative least-squares variance component estimation with application to GPS time series
    Amiri-Simkooei, A. R.
    JOURNAL OF GEODESY, 2016, 90 (05) : 451 - 466
  • [14] Non-negative least-squares variance component estimation with application to GPS time series
    A. R. Amiri-Simkooei
    Journal of Geodesy, 2016, 90 : 451 - 466
  • [15] A NOTE ON LEAST-SQUARES LEARNING PROCEDURES AND CLASSIFICATION BY NEURAL NETWORK MODELS
    SHOEMAKER, PA
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (01): : 158 - 160
  • [16] Orthogonal Matching Non-Negative Least Squares for Activity Detection in Unsourced Random Access
    Dang, Jian
    Zhang, Zhentian
    Zhang, Zaichen
    Wu, Liang
    Zhu, Bingcheng
    IEEE COMMUNICATIONS LETTERS, 2024, 28 (05) : 1191 - 1195
  • [17] Classification approach based on non-negative least squares
    Li, Yifeng
    Ngom, Alioune
    NEUROCOMPUTING, 2013, 118 : 41 - 57
  • [18] Simultaneous estimation of the dissociation constant and concentration by a linear least-squares method with non-negative constraint
    Yoshimura, N
    Okazaki, M
    Nakagawa, N
    ANALYTICAL SCIENCES, 2000, 16 (12) : 1331 - 1335
  • [19] Submicron Particle Size Distributions by Dynamic Light Scattering with Non-Negative Least-Squares Algorithm
    Ansari, Rafat R.
    Nyeo, Su-Long
    CHINESE JOURNAL OF PHYSICS, 2012, 50 (03) : 459 - 477
  • [20] ROBUST NON-NEGATIVE LEAST SQUARES USING SPARSITY
    Elvander, Filip
    Adalbjornsson, Stefan Ingi
    Jakobsson, Andreas
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 61 - 65