Extreme Learning Regression for nu Regularization

被引:2
|
作者
Ding, Xiao-Jian [1 ]
Yang, Fan [1 ]
Liu, Jian [1 ]
Cao, Jie [1 ]
机构
[1] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
MACHINE; NETWORKS;
D O I
10.1080/08839514.2020.1723863
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine for regression (ELR), though efficient, is not preferred in time-limited applications, due to the model selection time being large. To overcome this problem, we reformulate ELR to take a new regularization parameter nu (nu-ELR) which is inspired by Scholkopf et al. The regularization in terms of nu is bounded between 0 and 1, and is easier to interpret compared to C. In this paper, we propose using the active set algorithm to solve the quadratic programming optimization problem of nu-ELR. Experimental results on real regression problems show that nu-ELR performs better than ELM, ELR, and nu-SVR, and is computationally efficient compared to other iterative learning models. Additionally, the model selection time of nu-ELR can be significantly shortened.
引用
收藏
页码:378 / 395
页数:18
相关论文
共 50 条
  • [1] Optimization extreme learning machine with ν regularization
    Ding Xiao-jian
    Lan Yuan
    Zhang Zhi-feng
    Xu Xin
    NEUROCOMPUTING, 2017, 261 : 11 - 19
  • [2] Ensemble of Extreme Learning Machines for Regression
    Khellal, Atmane
    Ma, Hongbin
    Fei, Qing
    PROCEEDINGS OF 2018 IEEE 7TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS), 2018, : 1052 - 1057
  • [3] Functional extreme learning machine for regression and classification
    Liu, Xianli
    Zhou, Yongquan
    Meng, Weiping
    Luo, Qifang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 3768 - 3792
  • [4] Residual compensation extreme learning machine for regression
    Zhang, Jie
    Xiao, Wendong
    Li, Yanjiao
    Zhang, Sen
    NEUROCOMPUTING, 2018, 311 : 126 - 136
  • [5] Extreme Learning Machine for Regression and Multiclass Classification
    Huang, Guang-Bin
    Zhou, Hongming
    Ding, Xiaojian
    Zhang, Rui
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02): : 513 - 529
  • [6] Regularized extreme learning adaptive neuro-fuzzy algorithm for regression and classification
    Shihabudheen, K., V
    Pillai, G. N.
    KNOWLEDGE-BASED SYSTEMS, 2017, 127 : 100 - 113
  • [7] Extreme spectral regression for efficient regularized subspace learning
    Liu, Bing
    Xia, Shi-Xiong
    Meng, Fan-Rong
    Zhou, Yong
    NEUROCOMPUTING, 2015, 149 : 171 - 179
  • [8] Outlier-robust extreme learning machine for regression problems
    Zhang, Kai
    Luo, Minxia
    NEUROCOMPUTING, 2015, 151 : 1519 - 1527
  • [9] Extreme Learning Machine With Subnetwork Hidden Nodes for Regression and Classification
    Yang, Yimin
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (12) : 2885 - 2898
  • [10] Constructive hidden nodes selection of extreme learning machine for regression
    Lan, Yuan
    Soh, Yeng Chai
    Huang, Guang-Bin
    NEUROCOMPUTING, 2010, 73 (16-18) : 3191 - 3199