Data-Driven Minimax Optimization with Expectation Constraints

被引:2
作者
Yang, Shuoguang [1 ]
Li, Xudong [2 ]
Lan, Guanghui [3 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Ind Engn & Decis Analyt, Clear Water Bay, Hong Kong, Peoples R China
[2] Fudan Univ, Sch Data Sci, Shanghai 200433, Peoples R China
[3] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA 30332 USA
基金
中国国家自然科学基金; 美国国家科学基金会; 国家重点研发计划;
关键词
stochastic optimization; minimax optimization; primal-dual methods; expectation constraints;
D O I
10.1287/opre.2022.0110
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Attention to data-driven optimization approaches, including the well-known stochastic gradient descent method, has grown significantly over recent decades, but data driven constraints have rarely been studied because of the computational challenges of projections onto the feasible set defined by these hard constraints. In this paper, we focus on the nonsmooth convex-concave stochastic minimax regime and formulate the data-driven constraints as expectation constraints. The minimax expectation constrained problem subsumes a broad class of real-world applications, including data-driven robust optimization, optimization with misspecification, and area under the receiver operating characteristic curve (AUC) maximization with fairness constraints. We propose a class of efficient primal-dual algorithms to tackle the minimax expectation constrained problem and show that our algo root ffiffififfi rithms converge at the optimal rate of O(1= N), where N is the number of iterations. We demonstrate the practical efficiency of our algorithms by conducting numerical experiments on large-scale real-world applications.
引用
收藏
页码:1345 / 1365
页数:22
相关论文
共 55 条
[1]  
[Anonymous], 1997, Game theory: analysis of conflict
[2]  
[Anonymous], 2012, The theory of max-min and its application to weapons allocation problems
[3]  
Ben-Tal A, 2003, INT FED INFO PROC, V130, P1
[4]   Robust optimization - methodology and applications [J].
Ben-Tal, A ;
Nemirovski, A .
MATHEMATICAL PROGRAMMING, 2002, 92 (03) :453-480
[5]  
BenTal A, 2009, PRINC SER APPL MATH, P1
[6]  
Bertsekas DP., 1999, Nonlinear Programming, V2
[7]   The price of robustness [J].
Bertsimas, D ;
Sim, M .
OPERATIONS RESEARCH, 2004, 52 (01) :35-53
[8]   Robust discrete optimization and network flows [J].
Bertsimas, D ;
Sim, M .
MATHEMATICAL PROGRAMMING, 2003, 98 (1-3) :49-71
[9]   Massive MIMO Systems With Non-Ideal Hardware: Energy Efficiency, Estimation, and Capacity Limits [J].
Bjornson, Emil ;
Hoydis, Jakob ;
Kountouris, Marios ;
Debbah, Merouane .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (11) :7112-7139
[10]   Stochastic first-order methods for convex and nonconvex functional constrained optimization [J].
Boob, Digvijay ;
Deng, Qi ;
Lan, Guanghui .
MATHEMATICAL PROGRAMMING, 2023, 197 (01) :215-279