FAST NON-NEGATIVE LEAST-SQUARES LEARNING IN THE RANDOM NEURAL NETWORK

被引:3
|
作者
Timotheou, Stelios [1 ]
机构
[1] Univ Cyprus, KIOS Res Ctr Intelligent Syst & Networks, CY-1678 Nicosia, Cyprus
关键词
INITIALIZATION; ASSIGNMENT; HEURISTICS; ALGORITHM;
D O I
10.1017/S0269964816000061
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The random neural network is a biologically inspired neural model where neurons interact by probabilistically exchanging positive and negative unit-amplitude signals that has superior learning capabilities compared to other artificial neural networks. This paper considers non-negative least squares supervised learning in this context, and develops an approach that achieves fast execution and excellent learning capacity. This speedup is a result of significant enhancements in the solution of the non-negative least-squares problem which regard (a) the development of analytical expressions for the evaluation of the gradient and objective functions and (b) a novel limited-memory quasi-Newton solution algorithm. Simulation results in the context of optimizing the performance of a disaster management problem using supervised learning verify the efficiency of the approach, achieving two orders of magnitude execution speedup and improved solution quality compared to state-of-the-art algorithms.
引用
收藏
页码:379 / 402
页数:24
相关论文
共 50 条
  • [1] FAST NON-NEGATIVE ORTHOGONAL LEAST SQUARES
    Yaghoobi, Mehrdad
    Davies, Mike E.
    2015 23RD EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2015, : 479 - 483
  • [2] A Fast Scale-Invariant Algorithm for Non-negative Least Squares with Non-negative Data
    Diakonikolas, Jelena
    Li, Chenghui
    Padmanabhan, Swati
    Song, Chaobing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Spectral analysis rising regularized non-negative least-squares estimation
    Chiao, P
    Fessler, JA
    Zasadny, KR
    Wahl, RL
    1995 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE RECORD, VOLS 1-3, 1996, : 1680 - 1683
  • [5] Robust learning in a partial least-squares neural network
    Ham, FM
    McDowall, TM
    NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 1997, 30 (05) : 2903 - 2914
  • [6] Line-Search Aided Non-negative Least-Square Learning for Random Neural Network
    Yin, Yonghua
    INFORMATION SCIENCES AND SYSTEMS 2015, 2016, 363 : 181 - 189
  • [7] Nonnegative Least Squares Learning for the Random Neural Network
    Timotheou, Stelios
    ARTIFICIAL NEURAL NETWORKS - ICANN 2008, PT I, 2008, 5163 : 195 - 204
  • [8] Facial Expression Recognition via Non-Negative Least-Squares Sparse Coding
    Chen, Ying
    Zhang, Shiqing
    Zhao, Xiaoming
    INFORMATION, 2014, 5 (02) : 305 - 318
  • [9] THE LEAST-SQUARES ESTIMATION OF ADJUSTMENT MODEL CONSTRAINED BY SOME NON-NEGATIVE PARAMETERS
    Song, Yingchun
    Zhu, Jianjun
    Li, Zhiwei
    SURVEY REVIEW, 2010, 42 (315) : 62 - 71