FAST NON-NEGATIVE LEAST-SQUARES LEARNING IN THE RANDOM NEURAL NETWORK

被引:3
|
作者
Timotheou, Stelios [1 ]
机构
[1] Univ Cyprus, KIOS Res Ctr Intelligent Syst & Networks, CY-1678 Nicosia, Cyprus
关键词
INITIALIZATION; ASSIGNMENT; HEURISTICS; ALGORITHM;
D O I
10.1017/S0269964816000061
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The random neural network is a biologically inspired neural model where neurons interact by probabilistically exchanging positive and negative unit-amplitude signals that has superior learning capabilities compared to other artificial neural networks. This paper considers non-negative least squares supervised learning in this context, and develops an approach that achieves fast execution and excellent learning capacity. This speedup is a result of significant enhancements in the solution of the non-negative least-squares problem which regard (a) the development of analytical expressions for the evaluation of the gradient and objective functions and (b) a novel limited-memory quasi-Newton solution algorithm. Simulation results in the context of optimizing the performance of a disaster management problem using supervised learning verify the efficiency of the approach, achieving two orders of magnitude execution speedup and improved solution quality compared to state-of-the-art algorithms.
引用
收藏
页码:379 / 402
页数:24
相关论文
共 50 条
  • [21] Simultaneous Estimation of the Dissociation Constant and Concentration by a Linear Least-Squares Method with Non-Negative Constraint
    Norio Yoshimura
    Masanori Okazaki
    Naoya Nakagawa
    Analytical Sciences, 2000, 16 : 1331 - 1335
  • [22] FAST LEAST-SQUARES ALGORITHMS
    DAVIDON, WC
    AMERICAN JOURNAL OF PHYSICS, 1977, 45 (03) : 260 - 262
  • [23] Hyperspectral remote sensing data classification method based on sparse non-negative least-squares coding
    Qi Y.
    Yang L.
    Huo Y.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2016, 47 (07): : 332 - 337
  • [24] An interior point Newton-like method for non-negative least-squares problems with degenerate solution
    Bellavia, Stefania
    Macconi, Maria
    Morini, Benedetta
    NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2006, 13 (10) : 825 - 846
  • [26] Fast Sparse Non-Negative Least Squares via ADMM for High Resolution DOA Estimation
    Zheng, Chundi
    Yu, Meiyi
    Shan, Jiaolong
    Wang, Aiguo
    Chen, Huihui
    IEEE SENSORS JOURNAL, 2023, 23 (04) : 3901 - 3910
  • [27] Distance algorithm based procedure for non-negative least squares
    Rajko, Robert
    Zheng, Yu
    JOURNAL OF CHEMOMETRICS, 2014, 28 (09) : 691 - 695
  • [28] A partial least-squares regression neural NETwork (PLSNET) with supervised adaptive modular learning
    Ham, FM
    Kostanic, I
    APPLICATIONS AND SCIENCE OF ARTIFICIAL NEURAL NETWORKS II, 1996, 2760 : 139 - 150
  • [29] Convolutional Neural Network-Assisted Least-Squares Migration
    Boming Wu
    Hao Hu
    Hua-Wei Zhou
    Surveys in Geophysics, 2023, 44 : 1107 - 1124
  • [30] Deep convolutional neural network and sparse least-squares migration
    Liu, Zhaolun
    Chen, Yuqing
    Schuster, Gerard
    GEOPHYSICS, 2020, 85 (04) : WA241 - WA253