Adaptive ADMM for Dictionary Learning in Convolutional Sparse Representation

被引:23
作者
Peng, Guan-Ju [1 ]
机构
[1] Natl Chung Hsing Univ, Dept Appl Math, Taichung 402, Taiwan
关键词
Convolutional dictionary learning; convolutional sparse coding; non-convex and non-smooth optimization; ALTERNATING DIRECTION METHOD; RAIN STREAKS REMOVAL; LEAST-SQUARES; THRESHOLDING ALGORITHM; VARIABLE SELECTION; IMAGE; OPTIMIZATION; CONVERGENCE;
D O I
10.1109/TIP.2019.2896541
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel approach to convolutional sparse representation with the aim of resolving the dictionary learning problem. The proposed method, referred to as the adaptive alternating direction method of multipliers (AADMM), employs constraints comprising non-convex, non-smooth terms, such as the l(0)-norm imposed on the coefficients and the unit-norm sphere imposed on the length of each dictionary element. The proposed scheme incorporates a novel parameter adaption scheme that enables ADMM to achieve convergence more quickly, as evidenced by numerical and theoretical analysis. In experiments involving image signal applications, the dictionaries learned using AADMM outperformed those learned using comparable dictionary learning methods.
引用
收藏
页码:3408 / 3422
页数:15
相关论文
共 64 条
[1]  
Adil M, 2013, PROCEEDINGS OF THE 12TH EUROPEAN CONFERENCE ON RESEARCH METHODOLOGY FOR BUSINESS AND MANAGEMENT STUDIES, P1
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]  
[Anonymous], OPTIMIZATION METHODS
[4]  
[Anonymous], FOUND TRENDS MACH LE
[5]  
[Anonymous], 2010, Proceedings of the 27th International Conference on International Conference on Machine Learning
[6]  
[Anonymous], WORKING LOCALLY TH 2
[7]  
[Anonymous], P ICML
[8]   Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis [J].
Bao, Chenglong ;
Ji, Hui ;
Quan, Yuhui ;
Shen, Zuowei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (07) :1356-1369
[9]   Shift ∧ 2D Rotation Invariant Sparse Coding for Multivariate Signals [J].
Barthelemy, Quentin ;
Larue, Anthony ;
Mayoue, Aurelien ;
Mercier, David ;
Mars, Jerome I. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (04) :1597-1611
[10]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202