Cooperative Data-Driven Distributionally Robust Optimization

被引:24
作者
Cherukuri, Ashish [1 ]
Cortes, Jorge [2 ]
机构
[1] Univ Groningen, ENTEG, NL-9712 CP Groningen, Netherlands
[2] Univ Calif San Diego, Dept Mech & Aerosp Engn, San Diego, CA 92093 USA
关键词
Optimization; Random variables; Probability distribution; Measurement; Distributed algorithms; Linear programming; Convex functions; Data-driven methods; distributed optimization; distributionally robust optimization; multiagent systems;
D O I
10.1109/TAC.2019.2955031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study a class of multiagent stochastic optimization problems where the objective is to minimize the expected value of a function which depends on a random variable. The probability distribution of the random variable is unknown to the agents. The agents aim to cooperatively find, using their collected data, a solution with guaranteed out-of-sample performance. The approach is to formulate a data-driven distributionally robust optimization problem using Wasserstein ambiguity sets, which turns out to be equivalent to a convex program. We reformulate the latter as a distributed optimization problem and identify a convex-concave augmented Lagrangian, whose saddle points are in correspondence with the optimizers, provided a min-max interchangeability criteria is met. Our distributed algorithm design, then consists of the saddle-point dynamics associated to the augmented Lagrangian. We formally establish that the trajectories converge asymptotically to a saddle point and, hence, an optimizer of the problem. Finally, we identify classes of functions that meet the min-max interchangeability criteria.
引用
收藏
页码:4400 / 4407
页数:8
相关论文
共 30 条
[1]  
[Anonymous], 2018, Lectures on Network Systems. Version 0.96
[2]  
[Anonymous], 2015, ENCY SYSTEMS CONTROL
[3]  
[Anonymous], 1997, Princeton Landmarks in Mathematics
[4]   Nonpathological Lyapunov functions and discontinuous Caratheodory systems [J].
Bacciotti, A ;
Ceragioli, F .
AUTOMATICA, 2006, 42 (03) :453-458
[5]  
Bertsekas DP, 2003, Parallel and distributed computation: numerical methods, V2nd
[6]   Robust sample average approximation [J].
Bertsimas, Dimitris ;
Gupta, Vishal ;
Kallus, Nathan .
MATHEMATICAL PROGRAMMING, 2018, 171 (1-2) :217-282
[7]   ROBUST WASSERSTEIN PROFILE INFERENCE AND APPLICATIONS TO MACHINE LEARNING [J].
Blanchet, Jose ;
Kang, Yang ;
Murthy, Karthyek .
JOURNAL OF APPLIED PROBABILITY, 2019, 56 (03) :830-857
[8]   Quantifying Distributional Model Risk via Optimal Transport [J].
Blanchet, Jose ;
Murthy, Karthyek .
MATHEMATICS OF OPERATIONS RESEARCH, 2019, 44 (02) :565-600
[9]  
Cherukuri A., 2017, COOPERATIVE DATA DRI
[10]   The Role of Convexity in Saddle-Point Dynamics: Lyapunov Function and Robustness [J].
Cherukuri, Ashish ;
Mallada, Enrique ;
Low, Steven ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (08) :2449-2464