K-SVD with reference: an initialization method for dictionary learning

被引:2
作者
Cai, Pingmei [1 ]
Wang, Guinan [1 ]
Zhang, Hongjuan [1 ]
机构
[1] Shanghai Univ, Dept Math, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse signal recovery; Dictionary learning; Autocorrelation; Image denoising; CONSTRAINED ICA; SPARSE; EXTRACTION; REPRESENTATIONS; DECOMPOSITION; ALGORITHMS; SIGNALS; FOCUSS;
D O I
10.1007/s00521-014-1607-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, sparse signal recovery has received a lot attention for its wide real applications. Such a problem can be solved better if using a proper dictionary. Therefore, dictionary learning has become a promising direction and still been an open topic. As one of the greatest potential candidates, K-singular value decomposition (K-SVD) algorithm has been recognized by users. However, its performance has reached limitations of further improvement since it cannot consider the dependence between atoms. In this paper, we mine the inner structure of signals using their autocorrelations and make these prior as the reference. Based on these references, we present a new technique, which incorporates these references to K-SVD algorithm and provide a new method to initialize the dictionary. Experiments on synthetic data and image data show that the proposed algorithm has higher convergence ratio and lower error than the original K-SVD algorithm. Also, it performs better and more stable for sparse signal recovery.
引用
收藏
页码:1263 / 1274
页数:12
相关论文
共 32 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Extraction of specific signals with temporal structure [J].
Barros, AK ;
Cichocki, A .
NEURAL COMPUTATION, 2001, 13 (09) :1995-2003
[3]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[4]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[5]   Image denoising via sparse and redundant representations over learned dictionaries [J].
Elad, Michael ;
Aharon, Michal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) :3736-3745
[6]  
Elad M, 2010, SPARSE AND REDUNDANT REPRESENTATIONS, P3, DOI 10.1007/978-1-4419-7011-4_1
[7]   On compressive sensing applied to radar [J].
Ender, Joachim H. G. .
SIGNAL PROCESSING, 2010, 90 (05) :1402-1414
[8]  
Engan K., 1999, NORSIG-99. Norwegian Signal Processing Symposium, P65
[9]  
Engan K, 2005, INT CONF ACOUST SPEE, P653
[10]   Multi-frame compression: theory and design [J].
Engan, K ;
Aase, SO ;
Husoy, JH .
SIGNAL PROCESSING, 2000, 80 (10) :2121-2140