VARIATIONAL INFERENCE FOR NONPARAMETRIC SUBSPACE DICTIONARY LEARNING WITH HIERARCHICAL BETA PROCESS

被引:0
作者
Li, Shaoyang [1 ]
Tao, Xiaoming [1 ]
Lu, Jianhua [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, TNList, Beijing 100084, Peoples R China
来源
2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2017年
基金
中国国家自然科学基金;
关键词
Nonparametric Bayes; subspace dictionary learning; hierarchical Beta process; variational inference; image denoising;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Nonparametric Bayesian models have been implemented in dictionary learning. However, for signal samples from multiple subspaces, existing methods only learn one uniform dictionary and thus are not optimal for representing the subspace structures. To address this issue, we first utilize a combination of Dirichlet process and hierarchical Beta process as priors to infer the latent subspace number and dictionary dimension automatically; second, to derive tractable variational inference, we modify the priors with the Sethuraman's construction and further employ the multinomial approximation. Experimental results indicate that our approach can achieve a set of non-parametric subspace dictionaries, while showing performance enhancements in the tasks of image denoising.
引用
收藏
页码:2691 / 2695
页数:5
相关论文
共 50 条
  • [31] Design of Communication Systems Using Deep Learning: A Variational Inference Perspective
    Raj, Vishnu
    Kalyani, Sheetal
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (04) : 1320 - 1334
  • [32] Variational Hyperparameter Inference for Few-Shot Learning Across Domains
    Zhang, Lei
    Zuo, Liyun
    Wang, Baoyan
    Li, Xin
    Zhen, Xiantong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7448 - 7459
  • [33] Variational Inference MPC for Bayesian Model-based Reinforcement Learning
    Okada, Masashi
    Taniguchi, Tadahiro
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [34] Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation
    Fang, Kuan
    Zhu, Yuke
    Garg, Animesh
    Savarese, Silvio
    Li Fei-Fei
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [35] A variational inference based learning approach for decentralized building fire estimation
    Kou, Luyao
    Li, Yuxiao
    Wang, Xinzhi
    Peng, Ya
    Zhang, Hui
    JOURNAL OF BUILDING ENGINEERING, 2022, 62
  • [36] Incremental Kernel Principal Components Subspace Inference With Nystrom Approximation for Bayesian Deep Learning
    Wang, Yongguang
    Yao, Shuzhen
    Xu, Tian
    IEEE ACCESS, 2021, 9 : 36241 - 36251
  • [37] Stochastic variational inference for scalable non-stationary Gaussian process regression
    Ionut Paun
    Dirk Husmeier
    Colin J. Torney
    Statistics and Computing, 2023, 33
  • [38] Stochastic variational inference for scalable non-stationary Gaussian process regression
    Paun, Ionut
    Husmeier, Dirk
    Torney, Colin J.
    STATISTICS AND COMPUTING, 2023, 33 (02)
  • [39] A Variational Inference-Based Heteroscedastic Gaussian Process Approach for Simulation Metamodeling
    Wang, Wenjing
    Chen, Nan
    Chen, Xi
    Yang, Linchang
    ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2019, 29 (01):
  • [40] Variational learning for finite Beta-Liouville mixture models
    LAI Yu-ping
    ZHOU Ya-jian
    PING Yuan
    GUO Yu-cui
    YANG Yi-xian
    The Journal of China Universities of Posts and Telecommunications, 2014, 21 (02) : 98 - 103