iPiasco: Inertial Proximal Algorithm for Strongly Convex Optimization

被引:83
作者
Ochs, Peter [1 ]
Brox, Thomas [1 ]
Pock, Thomas [2 ,3 ]
机构
[1] Univ Freiburg, D-79106 Freiburg, Germany
[2] Graz Univ Technol, A-8010 Graz, Austria
[3] AIT Austrian Inst Technol GmbH, Digital Safety & Secur Dept, A-1220 Vienna, Austria
基金
奥地利科学基金会;
关键词
Heavy-ball method; Strongly convex optimization; Inertial proximal method; Convergence analysis; THRESHOLDING ALGORITHM; SIGNAL RECOVERY; MINIMIZATION; CONVERGENCE;
D O I
10.1007/s10851-015-0565-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a forward-backward splitting algorithm with additional inertial term for solving a strongly convex optimization problem of a certain type. The strongly convex objective function is assumed to be a sum of a non-smooth convex and a smooth convex function. This additional knowledge is used for deriving a worst-case convergence rate for the proposed algorithm. It is proved to be an optimal algorithm with linear rate of convergence. For certain problems this linear rate of convergence is better than the provably optimal worst-case rate of convergence for smooth strongly convex functions. We demonstrate the efficiency of the proposed algorithm in numerical experiments and examples from image processing.
引用
收藏
页码:171 / 181
页数:11
相关论文
共 29 条
[1]   Weak convergence of a relaxed and inertial hybrid projection-proximal point algorithm for maximal monotone operators in Hilbert space [J].
Alvarez, F .
SIAM JOURNAL ON OPTIMIZATION, 2004, 14 (03) :773-782
[2]   An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping [J].
Alvarez, F ;
Attouch, H .
SET-VALUED ANALYSIS, 2001, 9 (1-2) :3-11
[3]  
[Anonymous], 1993, COMPUTATIONAL MATH M, DOI DOI 10.1007/BF01128757
[4]  
[Anonymous], 2003, INTRO LECT CONVEX OP
[5]  
[Anonymous], Sov. Math. Dokl.
[6]  
[Anonymous], 1964, COMP MATH MATH PHYS+
[7]   A DYNAMICAL APPROACH TO AN INERTIAL FORWARD-BACKWARD ALGORITHM FOR CONVEX MINIMIZATION [J].
Attouch, Hedy ;
Peypouquet, Juan ;
Redont, Patrick .
SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) :232-256
[8]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[9]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[10]   A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration [J].
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :2992-3004