Decreasing the Size of the Restricted Boltzmann Machine

被引:1
|
作者
Saito, Yohei [1 ]
Kato, Takuya [2 ]
机构
[1] Univ Tokyo, Inst Ind Sci, Meguro Ku, Tokyo 1538505, Japan
[2] Univ Tokyo, Grad Sch Informat Sci & Technol, Dept Math informat, Bunkyo Ku, Tokyo 1138654, Japan
关键词
D O I
10.1162/neco_a_01176
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this letter, we propose a method to decrease the number of hidden units of the restricted Boltzmann machine while avoiding a decrease in the performance quantified by the Kullback-Leibler divergence. Our algorithm is then demonstrated by numerical simulations.
引用
收藏
页码:784 / 805
页数:22
相关论文
共 50 条
  • [1] Geometry of the Restricted Boltzmann Machine
    Cueto, Maria Angelica
    Morton, Jason
    Sturmfels, Bernd
    ALGEBRAIC METHODS IN STATISTICS AND PROBABILITY II, 2010, 516 : 135 - +
  • [2] An Infinite Restricted Boltzmann Machine
    Cote, Marc-Alexandre
    Larochelle, Hugo
    NEURAL COMPUTATION, 2016, 28 (07) : 1265 - 1288
  • [3] Tensorizing Restricted Boltzmann Machine
    Ju, Fujiao
    Sun, Yanfeng
    Gao, Junbin
    Antolovich, Michael
    Dong, Junliang
    Yin, Baocai
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2019, 13 (03)
  • [4] Universal Approximation Results for the Temporal Restricted Boltzmann Machine and the Recurrent Temporal Restricted Boltzmann Machine
    Odense, Simon
    Edwards, Roderick
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17 : 1 - 21
  • [5] Universal approximation results for the temporal restricted boltzmann machine and the recurrent temporal restricted Boltzmann machine
    Odense, Simon
    Edwards, Roderick
    Journal of Machine Learning Research, 2016, 17
  • [6] RESTRICTED BOLTZMANN MACHINE IMAGE COMPRESSION
    Kuechhold, Markus
    Simon, Maik
    Sikora, Thomas
    2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 243 - 247
  • [7] Matrix Variate Restricted Boltzmann Machine
    Qi, Guanglei
    Sun, Yanfeng
    Gao, Junbin
    Hu, Yongli
    Li, Jinghua
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 389 - 395
  • [8] A Removing Redundancy Restricted Boltzmann Machine
    Jiang, Yun
    Xiao, Jize
    Liu, Xi
    Hou, Jinquan
    PROCEEDINGS OF 2018 TENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2018, : 57 - 62
  • [9] VLSI Architectures for the Restricted Boltzmann Machine
    Yuan, Bo
    Parhi, Keshab K.
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2017, 13 (03)
  • [10] To be Bernoulli or to be Gaussian, for a Restricted Boltzmann Machine
    Yamashita, Takayoshi
    Tanaka, Masayuki
    Yoshida, Eiji
    Yamauchi, Yuji
    Fujiyoshi, Hironobu
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1520 - 1525