Adaptive ADMM for Dictionary Learning in Convolutional Sparse Representation

被引:23
作者
Peng, Guan-Ju [1 ]
机构
[1] Natl Chung Hsing Univ, Dept Appl Math, Taichung 402, Taiwan
关键词
Convolutional dictionary learning; convolutional sparse coding; non-convex and non-smooth optimization; ALTERNATING DIRECTION METHOD; RAIN STREAKS REMOVAL; LEAST-SQUARES; THRESHOLDING ALGORITHM; VARIABLE SELECTION; IMAGE; OPTIMIZATION; CONVERGENCE;
D O I
10.1109/TIP.2019.2896541
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel approach to convolutional sparse representation with the aim of resolving the dictionary learning problem. The proposed method, referred to as the adaptive alternating direction method of multipliers (AADMM), employs constraints comprising non-convex, non-smooth terms, such as the l(0)-norm imposed on the coefficients and the unit-norm sphere imposed on the length of each dictionary element. The proposed scheme incorporates a novel parameter adaption scheme that enables ADMM to achieve convergence more quickly, as evidenced by numerical and theoretical analysis. In experiments involving image signal applications, the dictionaries learned using AADMM outperformed those learned using comparable dictionary learning methods.
引用
收藏
页码:3408 / 3422
页数:15
相关论文
共 50 条
[21]   Sparse dictionary learning by block proximal gradient with global convergence [J].
Zhu, Tao .
NEUROCOMPUTING, 2019, 367 :226-235
[22]   Adaptive Compressive Beamforming Based on Bi-Sparse Dictionary Learning [J].
Guo, Qijia ;
Xin, Zhinan ;
Zhou, Tian ;
Yin, Jingwei ;
Cui, Hong-Liang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[23]   Adaptive Forward-Backward Splitting for Multilayer Convolutional Dictionary Learning [J].
Peng, Guan-Ju .
SIAM JOURNAL ON IMAGING SCIENCES, 2025, 18 (01) :631-664
[24]   A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators [J].
Li, Zhenni ;
Ding, Shuxue ;
Li, Yujie .
NEURAL COMPUTATION, 2015, 27 (09) :1951-1982
[25]   Efficient Approximate Online Convolutional Dictionary Learning [J].
Veshki, Farshad G. ;
Vorobyov, Sergiy A. .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 :1165-1175
[26]   ONLINE CONVOLUTIONAL DICTIONARY LEARNING [J].
Liu, Jialin ;
Garcia-Cardona, Cristina ;
Wohlberg, Brendt ;
Yin, Wotao .
2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, :1707-1711
[27]   Multifocus image fusion using convolutional dictionary learning with adaptive contrast enhancement [J].
Zhang, Chengfang .
JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (05)
[28]   BSPADMM: block splitting proximal ADMM for sparse representation with strong scalability [J].
Chen, Yidong ;
Pan, Jingshan ;
Han, Zidong ;
Hu, Yonghong ;
Guo, Meng ;
Lu, Zhonghua .
CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING, 2024, 6 (01) :3-16
[29]   Adaptive Stochastic ADMM for Decentralized Reinforcement Learning in Edge IoT [J].
Lei, Wanlu ;
Ye, Yu ;
Xiao, Ming ;
Skoglund, Mikael ;
Han, Zhu .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22) :22958-22971
[30]   Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis [J].
Bao, Chenglong ;
Ji, Hui ;
Quan, Yuhui ;
Shen, Zuowei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (07) :1356-1369