Fast Multiobjective Gradient Methods with Nesterov Acceleration via Inertial Gradient-Like Systems

被引:2
作者
Sonntag, Konstantin [1 ]
Peitz, Sebastian [2 ]
机构
[1] Paderborn Univ, Dept Math, D-33098 Paderborn, Germany
[2] Paderborn Univ, Dept Comp Sci, D-33098 Paderborn, Germany
关键词
Multiobjective optimization; Gradient methods; Nesterov acceleration; Inertial dynamics; Lyapunov analysis; DYNAMICAL-SYSTEM; PARETO-OPTIMIZATION; SLOW SOLUTIONS; EXISTENCE; CONVERGENCE;
D O I
10.1007/s10957-024-02389-3
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We derive efficient algorithms to compute weakly Pareto optimal solutions for smooth, convex and unconstrained multiobjective optimization problems in general Hilbert spaces. To this end, we define a novel inertial gradient-like dynamical system in the multiobjective setting, which trajectories converge weakly to Pareto optimal solutions. Discretization of this system yields an inertial multiobjective algorithm which generates sequences that converge weakly to Pareto optimal solutions. We employ Nesterov acceleration to define an algorithm with an improved convergence rate compared to the plain multiobjective steepest descent method (Algorithm 1). A further improvement in terms of efficiency is achieved by avoiding the solution of a quadratic subproblem to compute a common step direction for all objective functions, which is usually required in first-order methods. Using a different discretization of our inertial gradient-like dynamical system, we obtain an accelerated multiobjective gradient method that does not require the solution of a subproblem in each step (Algorithm 2). While this algorithm does not converge in general, it yields good results on test problems while being faster than standard steepest descent.
引用
收藏
页码:539 / 582
页数:44
相关论文
共 37 条
  • [2] A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics
    Alvarez, F
    Attouch, H
    Bolte, J
    Redont, P
    [J]. JOURNAL DE MATHEMATIQUES PURES ET APPLIQUEES, 2002, 81 (08): : 747 - 779
  • [3] An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping
    Alvarez, F
    Attouch, H
    [J]. SET-VALUED ANALYSIS, 2001, 9 (1-2): : 3 - 11
  • [4] The heavy ball with friction method, I. The continuous dynamical system: Global exploration of the local minima of a real-valued function by asymptotic analysis of a dissipative dynamical system
    Attouch, H
    Goudou, X
    Redont, P
    [J]. COMMUNICATIONS IN CONTEMPORARY MATHEMATICS, 2000, 2 (01) : 1 - 34
  • [5] Attouch H., 2015, ARXIV
  • [6] FROM THE RAVINE METHOD TO THE NESTEROV METHOD AND VICE VERSA: A DYNAMICAL SYSTEM PERSPECTIVE
    Attouch, Hedy
    Fadili, Jalal
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2022, 32 (03) : 2074 - 2101
  • [7] Attouch H, 2019, ESAIM CONTR OPTIM CA, V25, DOI 10.1051/cocv/2017083
  • [8] Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
    Attouch, Hedy
    Chbani, Zaki
    Peypouquet, Juan
    Redont, Patrick
    [J]. MATHEMATICAL PROGRAMMING, 2018, 168 (1-2) : 123 - 175
  • [9] THE RATE OF CONVERGENCE OF NESTEROV'S ACCELERATED FORWARD-BACKWARD METHOD IS ACTUALLY FASTER THAN 1/k2
    Attouch, Hedy
    Peypouquet, Juan
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (03) : 1824 - 1834
  • [10] A dynamic gradient approach to Pareto optimization with nonsmooth convex objective functions
    Attouch, Hedy
    Garrigos, Guillaume
    Goudou, Xavier
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2015, 422 (01) : 741 - 771