SCALABLE GAUSSIAN PROCESS USING INEXACT ADMM FOR BIG DATA

被引:0
|
作者
Xu, Yue [1 ,2 ]
Yin, Feng [2 ]
Zhang, Jiawei [2 ]
Xu, Wenjun [1 ]
Cui, Shuguang [2 ,3 ]
Luo, Zhi-Quan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Minist Educ, Key Lab Universal Wireless Commun, Beijing, Peoples R China
[2] Chinese Univ Hong Kong, Shenzhen, Peoples R China
[3] Univ Calif Davis, Dept Elect & Comp Engn, Davis, CA 95616 USA
来源
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2019年
基金
中国国家自然科学基金;
关键词
ADMM; big data; Gaussian process; hyper-parameter optimization; scalable model;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Gaussian process (GP) for machine learning has been well studied over the past two decades and is now widely used in many sectors. However, the design of low-complexity GP models still remains a challenging research problem. In this paper, we propose a novel scalable GP regression model for processing big datasets, using a large number of parallel computation units. In contrast to the existing methods, we solve the classic maximum likelihood based hyper-parameter optimization problem by a carefully designed distributed alternating direction method of multipliers (ADMM). The proposed method is parallelizable over a large number of computation units. Simulation results confirm the benefits of the proposed scalable GP model over the state-of-the-art distributed methods.
引用
收藏
页码:7495 / 7499
页数:5
相关论文
共 50 条
  • [1] Understanding and comparing scalable Gaussian process regression for big data
    Liu, Haitao
    Cai, Jianfei
    Ong, Yew-Soon
    Wang, Yi
    KNOWLEDGE-BASED SYSTEMS, 2019, 164 (324-335) : 324 - 335
  • [2] Distributed Gaussian Processes Hyperparameter Optimization for Big Data Using Proximal ADMM
    Xie, Ang
    Yin, Feng
    Xu, Yue
    Ai, Bo
    Chen, Tianshi
    Cui, Shuguang
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (08) : 1197 - 1201
  • [3] When Gaussian Process Meets Big Data: A Review of Scalable GPs
    Liu, Haitao
    Ong, Yew-Soon
    Shen, Xiaobo
    Cai, Jianfei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (11) : 4405 - 4423
  • [4] Scalable Gaussian Processes for Data-Driven Design Using Big Data With Categorical Factors
    Wang, Liwei
    Yerramilli, Suraj
    Iyer, Akshay
    Apley, Daniel
    Zhu, Ping
    Chen, Wei
    JOURNAL OF MECHANICAL DESIGN, 2022, 144 (02)
  • [5] Fast Gaussian Process Regression for Big Data
    Das, Sourish
    Roy, Sasanka
    Sambasivan, Rajiv
    BIG DATA RESEARCH, 2018, 14 : 12 - 26
  • [6] Parametric Gaussian process regression for big data
    Maziar Raissi
    Hessam Babaee
    George Em Karniadakis
    Computational Mechanics, 2019, 64 : 409 - 416
  • [7] Parametric Gaussian process regression for big data
    Raissi, Maziar
    Babaee, Hessam
    Karniadakis, George Em
    COMPUTATIONAL MECHANICS, 2019, 64 (02) : 409 - 416
  • [8] Mixture Gaussian process model with Gaussian mixture distribution for big data
    Guan, Yaonan
    He, Shaoying
    Ren, Shuangshuang
    Liu, Shuren
    Li, Dewei
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2024, 253
  • [9] Automatic Gaussian Process Model Retrieval for Big Data
    Berns, Fabian
    Beecks, Christian
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1965 - 1968
  • [10] Scalable Gaussian Process Computations Using Hierarchical Matrices
    Geoga, Christopher J.
    Anitescu, Mihai
    Stein, Michael L.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2020, 29 (02) : 227 - 237