Extreme Learning Regression for nu Regularization

被引:2
|
作者
Ding, Xiao-Jian [1 ]
Yang, Fan [1 ]
Liu, Jian [1 ]
Cao, Jie [1 ]
机构
[1] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
MACHINE; NETWORKS;
D O I
10.1080/08839514.2020.1723863
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine for regression (ELR), though efficient, is not preferred in time-limited applications, due to the model selection time being large. To overcome this problem, we reformulate ELR to take a new regularization parameter nu (nu-ELR) which is inspired by Scholkopf et al. The regularization in terms of nu is bounded between 0 and 1, and is easier to interpret compared to C. In this paper, we propose using the active set algorithm to solve the quadratic programming optimization problem of nu-ELR. Experimental results on real regression problems show that nu-ELR performs better than ELM, ELR, and nu-SVR, and is computationally efficient compared to other iterative learning models. Additionally, the model selection time of nu-ELR can be significantly shortened.
引用
收藏
页码:378 / 395
页数:18
相关论文
共 50 条
  • [31] Quantile regression with l1-regularization and Gaussian kernels
    Shi, Lei
    Huang, Xiaolin
    Tian, Zheng
    Suykens, Johan A. K.
    ADVANCES IN COMPUTATIONAL MATHEMATICS, 2014, 40 (02) : 517 - 551
  • [32] Extreme Learning Tree
    Akusok, Anton
    Eirola, Emil
    Bjork, Kaj-Mikael
    Lendasse, Amaury
    PROCEEDINGS OF ELM-2017, 2019, 10 : 181 - 185
  • [33] Bayesian learning of feature spaces for multitask regression
    Sevilla-Salcedo, Carlos
    Gallardo-Antolin, Ascension
    Gomez-Verdejo, Vanessa
    Parrado-Hernandez, Emilio
    NEURAL NETWORKS, 2024, 179
  • [34] On Regularization Based Twin Support Vector Regression with Huber Loss
    Gupta, Umesh
    Gupta, Deepak
    NEURAL PROCESSING LETTERS, 2021, 53 (01) : 459 - 515
  • [35] Single image super-resolution via regularized extreme learning regression for imagery from microgrid polarimeters
    Sargent, Garrett C.
    Ratliff, Bradley M.
    Asari, Vijayan K.
    POLARIZATION SCIENCE AND REMOTE SENSING VIII, 2017, 10407
  • [36] Deep kernel learning in extreme learning machines
    Afzal, A. L.
    Nair, Nikhitha K.
    Asharaf, S.
    PATTERN ANALYSIS AND APPLICATIONS, 2021, 24 (01) : 11 - 19
  • [37] Lake Water-Level fluctuations forecasting using Minimax Probability Machine Regression, Relevance Vector Machine, Gaussian Process Regression, and Extreme Learning Machine
    Bonakdari, Hossein
    Ebtehaj, Isa
    Samui, Pijush
    Gharabaghi, Bahram
    WATER RESOURCES MANAGEMENT, 2019, 33 (11) : 3965 - 3984
  • [38] A Regularization Framework for Learning Over Multitask Graphs
    Nassif, Roula
    Vlaski, Stefan
    Richard, Cedric
    Sayed, Ali H.
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (02) : 297 - 301
  • [39] A Novel Extreme Learning Control Framework of Unmanned Surface Vehicles
    Wang, Ning
    Sun, Jing-Chao
    Er, Meng Joo
    Liu, Yan-Cheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (05) : 1106 - 1117
  • [40] Heterogeneous Extreme Learning Machines
    Valdes, Julio J.
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1678 - 1685