Adaptive-Size Dictionary Learning Using Information Theoretic Criteria

被引:6
|
作者
Dumitrescu, Bogdan [1 ]
Giurcaneanu, Ciprian Doru [2 ]
机构
[1] Univ Politehn Bucuresti, Dept Automat Control & Comp, 313 Spl Independentei, Bucharest 060042, Romania
[2] Univ Auckland, Dept Stat, Auckland 1142, New Zealand
关键词
dictionary learning; sparse representation; information theoretic criteria; dictionary size; SELECTION; DESIGN; SVD;
D O I
10.3390/a12090178
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finding the size of the dictionary is an open issue in dictionary learning (DL). We propose an algorithm that adapts the size during the learning process by using Information Theoretic Criteria (ITC) specialized to the DL problem. The algorithm is built on top of Approximate K-SVD (AK-SVD) and periodically removes the less used atoms or adds new random atoms, based on ITC evaluations for a small number of candidate sub-dictionaries. Numerical experiments on synthetic data show that our algorithm not only finds the true size with very good accuracy, but is also able to improve the representation error in comparison with AK-SVD knowing the true size.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Improved Structured Dictionary Learning with Adaptive Block-size Using K-means Clustering
    Kumar, Nagendra
    Sinha, Rohit
    IEEE INDICON: 15TH IEEE INDIA COUNCIL INTERNATIONAL CONFERENCE, 2018,
  • [32] Adaptive Covers for Mapper Graphs Using Information Criteria
    Chalapathi, Nithin
    Zhou, Youjia
    Wang, Bei
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 3789 - 3800
  • [33] Adaptive sorting: an information theoretic perspective
    Elmasry, Amr
    Fredman, Michael L.
    ACTA INFORMATICA, 2008, 45 (01) : 33 - 42
  • [34] Adaptive sorting: an information theoretic perspective
    Amr Elmasry
    Michael L. Fredman
    Acta Informatica, 2008, 45 : 33 - 42
  • [35] Domain Adaptive Dictionary Learning
    Qiu, Qiang
    Patel, Vishal M.
    Turaga, Pavan
    Chellappa, Rama
    COMPUTER VISION - ECCV 2012, PT IV, 2012, 7575 : 631 - 645
  • [36] Blind Spectrum Sensing by Information Theoretic Criteria
    Wang, Rui
    Tao, Meixia
    2010 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE GLOBECOM 2010, 2010,
  • [37] Scale Adaptive Dictionary Learning
    Lu, Cewu
    Shi, Jianping
    Jia, Jiaya
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (02) : 837 - 847
  • [38] Quantitative MR Image Reconstruction Using Parameter-Specific Dictionary Learning With Adaptive Dictionary-Size and Sparsity-Level Choice
    Kofler, Andreas
    Kerkering, Kirsten Miriam
    Goeschel, Laura
    Fillmer, Ariane
    Kolbitsch, Christoph
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2024, 71 (02) : 388 - 399
  • [39] Using Information Theoretic Learning Techniques to Train Neural Networks
    Deb, Manas
    Ogunfunmi, Tokunbo
    2017 FIFTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2017, : 351 - 355
  • [40] An information theoretic approach to adaptive system training using unlabeled data
    Jeong, KH
    Xu, JW
    Principe, JC
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 191 - 195