Distributed Broad Learning System

被引:3
作者
Zhai, Yifan [1 ]
Liu, Ying [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
来源
ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING | 2018年
基金
中国国家自然科学基金;
关键词
Broad learning system; distributed processing; consensus; extreme learning machine auto-encoder; ALGORITHM;
D O I
10.1145/3383972.3384054
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, broad learning system (BLS) has been proposed and widely applied to the fields of machine learning and time series analysis. Compared with the well-known deep learning models, BLS does not need the deep architecture, and the learning process is time efficient. However, the existing BLS belongs to centralized processing, which is not applicable to the cases when data are distributed over multiple nodes. To solve this problem, in this paper, we propose a consensus-based distributed implementation of BLS (dBLS), in which each node cooperates with its one-hop neighbors to train the weights of the dBLS. Besides, a distributed extreme learning machine auto-encoder (dELM-AE) is also developed to refine the features extracted from the input data. Some simulations are performed and results show that the proposed dBLS is effective in solving distributed classification problems.
引用
收藏
页码:567 / 573
页数:7
相关论文
共 16 条
[1]  
[Anonymous], 2009, Deep boltzmann machines
[2]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[3]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[4]   Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture [J].
Chen, C. L. Philip ;
Liu, Zhulin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) :10-24
[5]   Fuzzy Broad Learning System: A Novel Neuro-Fuzzy Model for Regression and Classification [J].
Feng, Shuang ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) :414-424
[6]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[7]   A fast learning algorithm for deep belief nets [J].
Hinton, Geoffrey E. ;
Osindero, Simon ;
Teh, Yee-Whye .
NEURAL COMPUTATION, 2006, 18 (07) :1527-1554
[8]   Extreme learning machine: Theory and applications [J].
Huang, Guang-Bin ;
Zhu, Qin-Yu ;
Siew, Chee-Kheong .
NEUROCOMPUTING, 2006, 70 (1-3) :489-501
[9]  
Kasun LLC, 2013, IEEE INTELL SYST, V28, P31
[10]  
LeCun Y, 2004, PROC CVPR IEEE, P97