Proximal gradient nonconvex optimization algorithm for the slice-based?0-constrained convolutional dictionary learning

被引:2
作者
Li, Jing [1 ]
Wei, Xiao [1 ]
Li, Qiuhui [2 ]
Zhang, Yali [2 ]
Li, Ze [2 ]
Li, Jin [2 ]
Wang, Jinjia [2 ,3 ]
机构
[1] Yanshan Univ, Sch Sci, Qinhuangdao 066004, Hebei, Peoples R China
[2] Yanshan Univ, Sch Informat Sci & Engn, Qinhuangdao 066004, Hebei, Peoples R China
[3] Yanshan Univ, Hebei Key Lab Informat Transmiss & Signal Proc, Qinhuangdao 066004, Hebei, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional sparse representation; Slice -based dictionary learning; Nonconvex nonsmooth minimization; Proximal gradient method; Convergence; Image reconstruction; Image separation; ALTERNATING LINEARIZED MINIMIZATION; SPARSE REPRESENTATION; CARTOON;
D O I
10.1016/j.knosys.2022.110185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional dictionary learning (CDL) aims to learn a structured local convolutional dictionary and the sparse coefficient maps from the signals of various of interest, achieving better results than traditional patch-based dictionary learning in signal processing applications. Currently, most CDL methods are used to solve the 1-constrained pound convex CDL problem using the patch-based, Fourier-based, or slice-based representation, which may lead to non-sparse coefficient maps, thus degrading the performance of applications. The slice-based representation via local processing has shown more beneficial than the Fourier-based representation for convex CDL problems. It can allow a different number of nonzeros for each spatial location of the signal according to the local complexity. However, it has not been used for the nonconvex CDL problem. In this paper, a slice-based 0-constrained pound nonconvex CDL problem is proposed. It is the slice-based counterpart of the Fourier-based 0- pound constrained nonconvex CDL problems and the nonconvex extension of the slice-based 1-constrained pound convex CDL problems. A novel method named proximal gradient nonconvex optimization algorithm (PGNOA) is introduced. We prove that PGNOA can converge to a critical point. Extensive experiments are carried out on the benchmark data, and the results show that PGNOA is superior to the existing slice-based convex CDL methods and the Fourier-based nonconvex CDL methods in terms of the objective function value. The dictionaries learned from PGNOA are applied to image inpainting and image separation tasks. The experimental results demonstrate that PGNOA can perform better than other CDL methods. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 56 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods [J].
Attouch, Hedy ;
Bolte, Jerome ;
Svaiter, Benar Fux .
MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) :91-129
[3]   Proximal alternating linearized minimization for nonconvex and nonsmooth problems [J].
Bolte, Jerome ;
Sabach, Shoham ;
Teboulle, Marc .
MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) :459-494
[4]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[5]   Fast Convolutional Sparse Coding [J].
Bristow, Hilton ;
Eriksson, Anders ;
Lucey, Simon .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :391-398
[6]  
Chalasani R., 2013, 2013 INT JOINT C NEU, P1, DOI [10.1109/IJCNN.2013.6706854, DOI 10.1109/IJCNN.2013.6706854]
[7]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[8]   Convolutional Analysis Operator Learning: Acceleration and Convergence [J].
Chun, Il Yong ;
Fessler, Jeffrey A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (01) :2108-2122
[9]   Convolutional Dictionary Learning: Acceleration and Convergence [J].
Chun, Il Yong ;
Fessler, Jeffrey A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :1697-1712
[10]   Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering [J].
Ding, Ding ;
Ram, Sundaresh ;
Rodriguez, Jeffrey J. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) :1705-1719