Dual Alternating Direction Method of Multipliers for Inverse Imaging

被引:15
作者
Song, Li [1 ]
Ge, Zhou [1 ]
Lam, Edmund Y. [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
关键词
Imaging; Convex functions; Optimization; Superresolution; Convergence; Minimization; Linear programming; Inverse imaging; dual problem; D-ADMM; image super-resolution; RECONSTRUCTION;
D O I
10.1109/TIP.2022.3167915
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inverse imaging covers a wide range of imaging applications, including super-resolution, deblurring, and compressive sensing. We propose a novel scheme to solve such problems by combining duality and the alternating direction method of multipliers (ADMM). In addition to a conventional ADMM process, we introduce a second one that solves the dual problem to find the estimated nontrivial lower bound of the objective function, and the related iteration results are used in turn to guide the primal iterations. We call this D-ADMM, and show that it converges to the global minimum when the regularization function is convex and the optimization problem has at least one optimizer. Furthermore, we show how the scheme can give rise to two specific algorithms, called D-ADMM-L2 and D-ADMM-TV, by having different regularization functions. We compare D-ADMM-TV with other methods on image super-resolution and demonstrate comparable or occasionally slightly better quality results. This paves the way of incorporating advanced operators and strategies designed for basic ADMM into the D-ADMM method as well to further improve the performances of those methods.
引用
收藏
页码:3295 / 3308
页数:14
相关论文
共 52 条
[1]   An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems [J].
Afonso, Manya V. ;
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (03) :681-695
[2]   MoDL: Model-Based Deep Learning Architecture for Inverse Problems [J].
Aggarwal, Hemant K. ;
Mani, Merry P. ;
Jacob, Mathews .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :394-405
[3]  
[Anonymous], 2017, ARXIV170508041
[4]  
[Anonymous], 1974, Conjugate duality and optimization
[5]  
Barbero A., 2011, ICML, P313
[6]  
Barbero A, 2018, J MACH LEARN RES, V19
[7]   Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems [J].
Beck, Amir ;
Teboulle, Marc .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (11) :2419-2434
[8]  
Bertsekas D.P., 2014, Constrained optimization and Lagrange multiplier methods, DOI DOI 10.1016/C2013-0-10366-2
[9]  
Borwein J., 2010, Convex Analysis and Nonlinear Optimization: Theory and Examples
[10]  
Bot RI, 2009, VECTOR OPTIM, P1, DOI 10.1007/978-3-642-02886-1_1