Analysis Operator Learning and its Application to Image Reconstruction

被引:126
作者
Hawe, Simon [1 ]
Kleinsteuber, Martin [1 ]
Diepold, Klaus [1 ]
机构
[1] Tech Univ Munich, Dept Elect Engn, D-80290 Munich, Germany
关键词
Analysis operator learning; geometric conjugate gradient; image reconstruction; inverse problems; oblique manifold; SPARSE; REPRESENTATIONS; DICTIONARIES; TRANSFORM;
D O I
10.1109/TIP.2013.2246175
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Exploiting a priori known structural information lies at the core of many image reconstruction methods that can be stated as inverse problems. The synthesis model, which assumes that images can be decomposed into a linear combination of very few atoms of some dictionary, is now a well established tool for the design of image reconstruction algorithms. An interesting alternative is the analysis model, where the signal is multiplied by an analysis operator and the outcome is assumed to be sparse. This approach has only recently gained increasing interest. The quality of reconstruction methods based on an analysis model severely depends on the right choice of the suitable operator. In this paper, we present an algorithm for learning an analysis operator from training images. Our method is based on l(p)-norm minimization on the set of full rank matrices with normalized columns. We carefully introduce the employed conjugate gradient method on manifolds, and explain the underlying geometry of the constraints. Moreover, we compare our approach to state-of-the-art methods for image denoising, inpainting, and single image super-resolution. Our numerical results show competitive performance of our general approach in all presented applications compared to the specialized state-of-the-art techniques.
引用
收藏
页码:2138 / 2150
页数:13
相关论文
共 38 条
[1]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[4]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[5]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[6]   Algorithms and software for total variation image reconstruction via first-order methods [J].
Dahl, Joachim ;
Hansen, Per Christian ;
Jensen, Soren Holdt ;
Jensen, Tobias Lindstrom .
NUMERICAL ALGORITHMS, 2010, 53 (01) :67-92
[7]   An efficient hybrid conjugate gradient method for unconstrained optimization [J].
Dai, YH ;
Yuan, Y .
ANNALS OF OPERATIONS RESEARCH, 2001, 103 (1-4) :33-47
[8]   Analysis versus synthesis in signal priors [J].
Elad, Michael ;
Milanfar, Peyman ;
Rubinstein, Ron .
INVERSE PROBLEMS, 2007, 23 (03) :947-968
[9]   Image denoising via sparse and redundant representations over learned dictionaries [J].
Elad, Michael ;
Aharon, Michal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) :3736-3745
[10]   On the Role of Sparse and Redundant Representations in Image Processing [J].
Elad, Michael ;
Figueiredo, Mario A. T. ;
Ma, Yi .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :972-982