A pruning algorithm with L1/2 regularizer for extreme learning machine

被引:0
作者
Ye-tian FAN [1 ]
Wei WU [1 ]
Wen-yu YANG [2 ]
Qin-wei FAN [1 ]
Jian WANG [1 ]
机构
[1] School of Mathematical Sciences,Dalian University of Technology
[2] College of Science,Huazhong Agricultural University
基金
中央高校基本科研业务费专项资金资助; 中国国家自然科学基金;
关键词
Extreme learning machine(ELM); L1/2; regularizer; Network pruning;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared with traditional learning methods such as the back propagation(BP)method,extreme learning machine provides much faster learning speed and needs less human intervention,and thus has been widely used.In this paper we combine the L1/2regularization method with extreme learning machine to prune extreme learning machine.A variable learning coefcient is employed to prevent too large a learning increment.A numerical experiment demonstrates that a network pruned by L1/2regularization has fewer hidden nodes but provides better performance than both the original network and the network pruned by L2regularization.
引用
收藏
页码:119 / 125
页数:7
相关论文
共 8 条
  • [1] 基于在线学习神经网络的状态依赖型故障预测
    徐贵斌
    周东华
    [J]. 浙江大学学报(工学版), 2010, 44 (07) : 1251 - 1254+1320
  • [2] 标准神经网络模型及其应用
    颜钢锋
    张森林
    刘妹琴
    [J]. 浙江大学学报(工学版), 2004, (03) : 42 - 46+95
  • [3] Robust extreme learning machine[J] . Punyaphol Horata,Sirapat Chiewchanwattana,Khamron Sunat.Neurocomputing . 2013
  • [4] TROP-ELM: A double-regularized ELM using LARS and Tikhonov regularization[J] . Yoan Miche,Mark van Heeswijk,Patrick Bas,Olli Simula,Amaury Lendasse.Neurocomputing . 2011 (16)
  • [5] Extreme learning machine: Theory and applications[J] . Guang-Bin Huang,Qin-Yu Zhu,Chee-Kheong Siew.Neurocomputing . 2006 (1)
  • [6] Atomic decomposition by basis pursuit
    Chen, SSB
    Donoho, DL
    Saunders, MA
    [J]. SIAM REVIEW, 2001, 43 (01) : 129 - 159
  • [7] Extreme learning machines: A survey. Huang, Guang-Bin,Wang, Dian Hui,Lan, Yuan. International Journal of Machine Learning and Cybernetics . 2011
  • [8] Extreme learning machine:RBF networkcase. HUANG G B,SIEW C K. Proceedings of the eighth international conference on control, automation, robotics and vision (ICARCV 2004) . 2004