FAST NON-NEGATIVE LEAST-SQUARES LEARNING IN THE RANDOM NEURAL NETWORK

被引:3
|
作者
Timotheou, Stelios [1 ]
机构
[1] Univ Cyprus, KIOS Res Ctr Intelligent Syst & Networks, CY-1678 Nicosia, Cyprus
关键词
INITIALIZATION; ASSIGNMENT; HEURISTICS; ALGORITHM;
D O I
10.1017/S0269964816000061
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The random neural network is a biologically inspired neural model where neurons interact by probabilistically exchanging positive and negative unit-amplitude signals that has superior learning capabilities compared to other artificial neural networks. This paper considers non-negative least squares supervised learning in this context, and develops an approach that achieves fast execution and excellent learning capacity. This speedup is a result of significant enhancements in the solution of the non-negative least-squares problem which regard (a) the development of analytical expressions for the evaluation of the gradient and objective functions and (b) a novel limited-memory quasi-Newton solution algorithm. Simulation results in the context of optimizing the performance of a disaster management problem using supervised learning verify the efficiency of the approach, achieving two orders of magnitude execution speedup and improved solution quality compared to state-of-the-art algorithms.
引用
收藏
页码:379 / 402
页数:24
相关论文
共 50 条
  • [41] TNT-NN: A Fast Active Set Method for Solving Large Non-Negative Least Squares Problems
    Myre, J. M.
    Frahm, E.
    Lilja, D. J.
    Saar, M. O.
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 755 - 764
  • [42] A FAST SPARSE COVARIANCE-BASED FITTING METHOD FOR DOA ESTIMATION VIA NON-NEGATIVE LEAST SQUARES
    Zheng, Chundi
    Chen, Huihui
    Wang, Aiguo
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4786 - 4790
  • [43] NON-NEGATIVE OBSERVABLES ARE SQUARES
    SHERMAN, S
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 1951, 2 (01) : 31 - 33
  • [44] Robust partial least-squares regression: A modular neural network approach
    McDowall, TM
    Ham, FM
    APPLICATIONS AND SCIENCE OF ARTIFICIAL NEURAL NETWORKS III, 1997, 3077 : 344 - 355
  • [45] NON-NEGATIVE OBSERVABLES ARE SQUARES
    SHERMAN, S
    BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 1950, 56 (02) : 169 - 169
  • [46] GPS navigation solutions by analogue neural network least-squares processors
    Jwo, DJ
    JOURNAL OF NAVIGATION, 2005, 58 (01): : 105 - 118
  • [47] A non-monotonic method for large-scale non-negative least squares
    Kim, Dongmin
    Sra, Suvrit
    Dhillon, Inderjit S.
    OPTIMIZATION METHODS & SOFTWARE, 2013, 28 (05): : 1012 - 1039
  • [48] Random errors in interferometry with the least-squares method
    Wang, Qi
    APPLIED OPTICS, 2011, 50 (03) : 246 - 252
  • [49] Random projections for the nonnegative least-squares problem
    Boutsidis, Christos
    Drineas, Petros
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2009, 431 (5-7) : 760 - 771
  • [50] Least-squares estimators in a stationary random field
    Department of Mathematics, Indian Inst. of Technology Kanpur, Kanpur 208 016, India
    J Indian Inst Sci, 2 (75-88):