The proximal alternating iterative hard thresholding method for l0 minimization, with complexity O (1/√k)

被引:9
作者
Yang, Fan [1 ]
Shen, Yi [1 ]
Liu, Zhi Song [2 ]
机构
[1] Zhejiang Sci Tech Univ, Dept Math, Hangzhou 310028, Zhejiang, Peoples R China
[2] Zhejiang Ocean Univ, Sch Math Phys & Informat Sci, Zhoushan 316004, Peoples R China
关键词
Sparse approximation; Alternating minimization; Hard thresholding; Tight wavelet frame; Kurdyka-Lojasiewicz property; LOJASIEWICZ INEQUALITY; IMAGE-RESTORATION; ALGORITHM; NONCONVEX; SYSTEMS;
D O I
10.1016/j.cam.2016.07.013
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Since digital images are usually sparse in the wavelet frame domain, some nonconvex minimization models based on wavelet frame have been proposed and sparse approximations have been widely used in image restoration in recent years. Among them, the proximal alternating iterative hard thresholding method is proposed in this paper to solve the nonconvex model based on wavelet frame. Through combining the proposed algorithm with the iterative hard thresholding algorithm which is well studied in compressed sensing theory, this paper proves that the complexity of the proposed method is O (1 / root k). On the other hand, a more general nonconvex-nonsmooth model is adopted and the pseudo proximal alternating linearized minimization method is developed to solve the above problem. With the Kurdyka-Lojasiewicz (KL) property, it is proved that the sequence generated by the proposed algorithm converges to some critical points of the corresponding model. Finally, the proposed method is applied to restore the blurred noisy gray images. As the numerical results reveal, the performance of the proposed method is comparable or better than some well-known convex image restoration methods. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:115 / 129
页数:15
相关论文
共 21 条
[1]  
[Anonymous], 2012, MATRIX COMPUTATIONS
[2]   On the convergence of the proximal algorithm for nonsmooth functions involving analytic features [J].
Attouch, Hedy ;
Bolte, Jerome .
MATHEMATICAL PROGRAMMING, 2009, 116 (1-2) :5-16
[3]   Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality [J].
Attouch, Hedy ;
Bolte, Jerome ;
Redont, Patrick ;
Soubeyran, Antoine .
MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) :438-457
[4]  
Bao C., 2015, EXTRAPOLATED P UNPUB
[5]   Convergence analysis for iterative data-driven tight frame construction scheme [J].
Bao, Chenglong ;
Ji, Hui ;
Shen, Zuowei .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2015, 38 (03) :510-523
[6]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[7]   Iterative Thresholding for Sparse Approximations [J].
Blumensath, Thomas ;
Davies, Mike E. .
JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2008, 14 (5-6) :629-654
[8]   THE LOJASIEWICZ INEQUALITY FOR NONSMOOTH SUBANALYTIC FUNCTIONS WITH APPLICATIONS TO SUBGRADIENT DYNAMICAL SYSTEMS [J].
Bolte, Jerome ;
Daniilidis, Aris ;
Lewis, Adrian .
SIAM JOURNAL ON OPTIMIZATION, 2007, 17 (04) :1205-1223
[9]   Proximal alternating linearized minimization for nonconvex and nonsmooth problems [J].
Bolte, Jerome ;
Sabach, Shoham ;
Teboulle, Marc .
MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) :459-494
[10]   CHARACTERIZATIONS OF LOJASIEWICZ INEQUALITIES: SUBGRADIENT FLOWS, TALWEG, CONVEXITY [J].
Bolte, Jerome ;
Daniilidis, Aris ;
Ley, Olivier ;
Mazet, Laurent .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 2010, 362 (06) :3319-3363