Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes

被引:19
作者
Blanchet, Jose [1 ]
Murthy, Karthyek [2 ]
Zhang, Fan [1 ]
机构
[1] Stanford Univ, Management Sci & Engn, Stanford, CA 94305 USA
[2] Singapore Univ Technol & Design, Engn Syst & Design, Singapore 487372, Singapore
基金
美国国家科学基金会;
关键词
distributionally robust optimization; stochastic gradient descent; optimal transport; Wasserstein distances; adversarial; strong convexity; comparative statics; rate of convergence; STOCHASTIC-APPROXIMATION; PROGRAMS;
D O I
10.1287/moor.2021.1178
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider optimal transport-based distributionally robust optimization (DRO) problems with locally strongly convex transport cost functions and affine decision rules. Under conventional convexity assumptions on the underlying loss function, we obtain structural results about the value function, the optimal policy, and the worst-case optimal transport adversarial model. These results expose a rich structure embedded in the DRO problem (e.g., strong convexity even if the non-DRO problem is not strongly convex, a suitable scaling of the Lagrangian for the DRO constraint, etc., which are crucial for the design of efficient algorithms). As a consequence of these results, one can develop efficient optimization procedures that have the same sample and iteration complexity as a natural non-DRO benchmark algorithm, such as stochastic gradient descent.
引用
收藏
页码:1500 / 1529
页数:30
相关论文
共 36 条
[1]   Katyusha: The First Direct Acceleration of Stochastic Gradient Methods [J].
Allen-Zhu, Zeyuan .
STOC'17: PROCEEDINGS OF THE 49TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING, 2017, :1200-1205
[2]   Stochastic Optimization Problems with Nondifferentiable Cost Functionals [J].
Bertsekas, D. P. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1973, 12 (02) :218-231
[3]  
Bertsekas D. P., 1996, Neuro-Dynamic Programming
[4]  
Blanchet J, 2019, CONFIDENCE REG UNPUB
[5]  
Blanchet J, 2019, WINT SIMUL C PROC, P3740, DOI [10.1109/WSC40007.2019.9004785, 10.1109/wsc40007.2019.9004785]
[6]   ROBUST WASSERSTEIN PROFILE INFERENCE AND APPLICATIONS TO MACHINE LEARNING [J].
Blanchet, Jose ;
Kang, Yang ;
Murthy, Karthyek .
JOURNAL OF APPLIED PROBABILITY, 2019, 56 (03) :830-857
[7]   Quantifying Distributional Model Risk via Optimal Transport [J].
Blanchet, Jose ;
Murthy, Karthyek .
MATHEMATICS OF OPERATIONS RESEARCH, 2019, 44 (02) :565-600
[8]  
Chen Z, 2018, ARXIV180900210
[9]  
Defazio A, 2014, ADV NEUR IN, V27
[10]   Efficient line search methods for convex functions [J].
Den Boef, Edgar ;
Den Hertog, Dick .
SIAM JOURNAL ON OPTIMIZATION, 2007, 18 (01) :338-363