Nesterov's Method for Convex Optimization

被引:6
|
作者
Walkington, Noel J. [1 ]
机构
[1] Carnegie Mellon Univ, Dept Math, Pittsburgh, PA 15213 USA
关键词
convex optimization; Nesterov's algorithm; steepest descent;
D O I
10.1137/21M1390037
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
While Nesterov's algorithm for computing the minimum of a convex function is now over forty years old, it is rarely presented in texts for a first course in optimization. This is unfortunate since for many problems this algorithm is superior to the ubiquitous steepest descent algorithm, and it is equally simple to implement. This article presents an elementary analysis of Nesterov's algorithm that parallels that of steepest descent. It is envisioned that this presentation of Nesterov's algorithm could easily be covered in a few lectures following the introductory material on convex functions and steepest descent included in every course on optimization.
引用
收藏
页码:539 / 562
页数:24
相关论文
共 50 条
  • [1] On the transient growth of Nesterov's accelerated method for strongly convex optimization problems
    Samuelson, Samantha
    Mohammadi, Hesameddin
    Jovanovic, Mihailo R.
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 5911 - 5916
  • [2] Performance of noisy Nesterov's accelerated method for strongly convex optimization problems
    Mohammadi, Hesameddin
    Razaviyayn, Meisam
    Jovanovic, Mihailo R.
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 3426 - 3431
  • [3] A secant-based Nesterov method for convex functions
    Alli-Oke, Razak O.
    Heath, William P.
    OPTIMIZATION LETTERS, 2017, 11 (01) : 81 - 105
  • [4] A secant-based Nesterov method for convex functions
    Razak O. Alli-Oke
    William P. Heath
    Optimization Letters, 2017, 11 : 81 - 105
  • [5] An Extension of the Second Order Dynamical System that Models Nesterov’s Convex Gradient Method
    Cristian Daniel Alecsa
    Szilárd Csaba László
    Titus Pinţa
    Applied Mathematics & Optimization, 2021, 84 : 1687 - 1716
  • [6] An Extension of the Second Order Dynamical System that Models Nesterov's Convex Gradient Method
    Alecsa, Cristian Daniel
    Laszlo, Szilard Csaba
    Pinta, Titus
    APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 84 (02) : 1687 - 1716
  • [7] Vaidya’s Method for Convex Stochastic Optimization Problems in Small Dimension
    E. L. Gladin
    A. V. Gasnikov
    E. S. Ermakova
    Mathematical Notes, 2022, 112 : 183 - 190
  • [8] Vaidya's Method for Convex Stochastic Optimization Problems in Small Dimension
    Gladin, E. L.
    Gasnikov, A., V
    Ermakova, E. S.
    MATHEMATICAL NOTES, 2022, 112 (1-2) : 183 - 190
  • [9] Polyak Minorant Method for Convex Optimization
    Devanathan, Nikhil
    Boyd, Stephen
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 203 (03) : 2263 - 2282
  • [10] Barrier method in nonsmooth convex optimization without convex representation
    Joydeep Dutta
    Optimization Letters, 2015, 9 : 1177 - 1185