A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique

被引:7
作者
Karapetyants, Mikhail A. [1 ]
机构
[1] Univ Vienna, Fac Math, Oskar Morgenstern Pl 1, A-1090 Vienna, Austria
基金
奥地利科学基金会;
关键词
Nonsmooth convex optimization; Damped inertial dynamics; Hessian-driven damping; Moreau envelope; Proximal operator; Tikhonov regularization; Strong convergence; DAMPED INERTIAL DYNAMICS; CONVERGENCE;
D O I
10.1007/s10589-023-00536-6
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessian-driven damping with a Tikhonov regularization term. In our analysis we heavily exploit the Moreau envelope of the objective function and its properties as well as Tikhonov regularization properties, which we extend to a nonsmooth case. We introduce the setting, which at the same time guarantees the fast convergence of the function (and Moreau envelope) values and strong convergence of the trajectories of the system to a minimal norm solution-the element of the minimal norm of all the minimizers of the objective. Moreover, we deduce the precise rates of convergence of the values for the particular choice of parameters. Various numerical examples are also included as an illustration of the theoretical results.
引用
收藏
页码:531 / 569
页数:39
相关论文
共 14 条
[1]  
Attouch H., 2021, ARXIV
[2]   Accelerated Gradient Methods Combining Tikhonov Regularization with Geometric Damping Driven by the Hessian [J].
Attouch, Hedy ;
Balhag, Aicha ;
Chbani, Zaki ;
Riahi, Hassan .
APPLIED MATHEMATICS AND OPTIMIZATION, 2023, 88 (02)
[3]   Damped inertial dynamics with vanishing Tikhonov regularization: Strong asymptotic convergence towards the minimum norm solution [J].
Attouch, Hedy ;
Balhag, Aicha ;
Chbani, Zaki ;
Riahi, Hassan .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2022, 311 :29-58
[4]   Continuous Newton-like Inertial Dynamics for Monotone Inclusions [J].
Attouch, Hedy ;
Laszlo, Szilard Csaba .
SET-VALUED AND VARIATIONAL ANALYSIS, 2021, 29 (03) :555-581
[5]   Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators [J].
Attouch, Hedy ;
Peypouquet, Juan .
MATHEMATICAL PROGRAMMING, 2019, 174 (1-2) :391-432
[6]   Convergence of damped inertial dynamics governed by regularized maximally monotone operators [J].
Attouch, Hedy ;
Cabot, Alexandre .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2018, 264 (12) :7138-7182
[7]   Combining fast inertial dynamics for convex optimization with Tikhonov regularization [J].
Attouch, Hedy ;
Chbani, Zaki ;
Riahi, Hassan .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2018, 457 (02) :1065-1094
[8]   Fast convex optimization via inertial dynamics with Hessian driven damping [J].
Attouch, Hedy ;
Peypouquet, Juan ;
Redont, Patrick .
JOURNAL OF DIFFERENTIAL EQUATIONS, 2016, 261 (10) :5734-5783
[9]  
Bauschke H. H., 2016, Convex Analysis and Monotone Operator Theory in Hilbert Spaces
[10]   On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions  [J].
Bot, Radu Ioan ;
Csetnek, Ernoe Robert ;
Laszlo, Szilard Csaba .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2024, 530 (02)