SCALABLE GAUSSIAN PROCESS USING INEXACT ADMM FOR BIG DATA

被引:0
作者
Xu, Yue [1 ,2 ]
Yin, Feng [2 ]
Zhang, Jiawei [2 ]
Xu, Wenjun [1 ]
Cui, Shuguang [2 ,3 ]
Luo, Zhi-Quan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Minist Educ, Key Lab Universal Wireless Commun, Beijing, Peoples R China
[2] Chinese Univ Hong Kong, Shenzhen, Peoples R China
[3] Univ Calif Davis, Dept Elect & Comp Engn, Davis, CA 95616 USA
来源
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2019年
基金
中国国家自然科学基金;
关键词
ADMM; big data; Gaussian process; hyper-parameter optimization; scalable model;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Gaussian process (GP) for machine learning has been well studied over the past two decades and is now widely used in many sectors. However, the design of low-complexity GP models still remains a challenging research problem. In this paper, we propose a novel scalable GP regression model for processing big datasets, using a large number of parallel computation units. In contrast to the existing methods, we solve the classic maximum likelihood based hyper-parameter optimization problem by a carefully designed distributed alternating direction method of multipliers (ADMM). The proposed method is parallelizable over a large number of computation units. Simulation results confirm the benefits of the proposed scalable GP model over the state-of-the-art distributed methods.
引用
收藏
页码:7495 / 7499
页数:5
相关论文
共 50 条
[21]   EMR: Scalable Clustering of Big HR Data using Evolutionary MapReduce [J].
Bohlouli, Mahdi ;
He, Zhonghua .
WEB CONFERENCE 2021: COMPANION OF THE WORLD WIDE WEB CONFERENCE (WWW 2021), 2021, :26-34
[22]   gptools: Scalable Gaussian Process Inference with Stan [J].
Hoffmann, Till ;
Onnela, Jukka-Pekka .
JOURNAL OF STATISTICAL SOFTWARE, 2025, 112 (02) :1-31
[23]   Scalable Soft Sensor for Nonlinear Industrial Big Data via Bagging Stochastic Variational Gaussian Processes [J].
Zhu, Jinlin ;
Jiang, Muyun ;
Peng, Guohao ;
Yao, Le ;
Ge, Zhiqiang .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (08) :7594-7602
[24]   SCALABLE GRAPH SIGNAL RECOVERY FOR BIG DATA OVER NETWORKS [J].
Jung, Alexander ;
Berger, Peter ;
Hannak, Gabor ;
Matz, Gerald .
2016 IEEE 17TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2016,
[25]   Bridge the Gap Between ADMM and Stackelberg Game: Incentive Mechanism Design for Big Data Networks [J].
Zheng, Zijie ;
Song, Lingyang ;
Han, Zhu .
IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (02) :191-195
[26]   Building Data Warehouses in the Era of Big Data An Approach for Scalable and Flexible Big Data Warehouses [J].
Costa, Carlos ;
Santos, Maribel Yasmina .
ADVANCED INFORMATION SYSTEMS ENGINEERING (CAISE 2019), 2019, 11483 :693-695
[27]   Business Process Analytics Using a Big Data Approach [J].
Vera-Baquero, Alejandro ;
Colomo-Palacios, Ricardo ;
Molloy, Owen .
IT PROFESSIONAL, 2013, 15 (06) :29-35
[28]   Special aspects of using Big Data in the learning process [J].
Agatova, Olga ;
Popov, Alexander ;
Alwaely, Suad Abdalkareem .
INTERACTIVE LEARNING ENVIRONMENTS, 2024, 32 (03) :1105-1116
[29]   How big are the lag increments of a Gaussian process? [J].
Choi, YK ;
Hwang, KS .
COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2000, 40 (8-9) :911-919
[30]   Scalable Sentiment Classification for Big Data Analysis Using Naive Bayes Classifier [J].
Liu, Bingwei ;
Blasch, Erik ;
Chen, Yu ;
Shen, Dan ;
Chen, Genshe .
2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,