Optimization under uncertainty in the era of big data and deep learning: When machine learning meets mathematical programming

被引:226
作者
Ning, Chao [1 ]
You, Fengqi [1 ]
机构
[1] Cornell Univ, Robert Frederick Smith Sch Chem & Biomol Engn, Ithaca, NY 14853 USA
关键词
Data-driven optimization; Decision making under uncertainty; Big data; Machine learning; Deep learning; DRIVEN ROBUST OPTIMIZATION; SUPPLY CHAIN DESIGN; CHANCE-CONSTRAINED OPTIMIZATION; GENERALIZED BENDERS DECOMPOSITION; MODEL-PREDICTIVE CONTROL; L-SHAPED METHOD; CONVEX-PROGRAMS; DECISION-MAKING; UNIT COMMITMENT; COMPUTATIONAL FRAMEWORK;
D O I
10.1016/j.compchemeng.2019.03.034
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper reviews recent advances in the field of optimization under uncertainty via a modern data lens, highlights key research challenges and promise of data-driven optimization that organically integrates machine learning and mathematical programming for decision-making under uncertainty, and identifies potential research opportunities. A brief review of classical mathematical programming techniques for hedging against uncertainty is first presented, along with their wide spectrum of applications in Process Systems Engineering. A comprehensive review and classification of the relevant publications on data-driven distributionally robust optimization, data-driven chance constrained program, data-driven robust optimization, and data-driven scenario-based optimization is then presented. This paper also identifies fertile avenues for future research that focuses on a closed-loop data-driven optimization framework, which allows the feedback from mathematical programming to machine learning, as well as scenario-based optimization leveraging the power of deep learning techniques. Perspectives on online learning-based data-driven multistage optimization with a learning-while-optimizing scheme are presented. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:434 / 448
页数:15
相关论文
共 209 条
[1]   Stochastic optimization based algorithms for process synthesis under uncertainty [J].
Acevedo, J ;
Pistikopoulos, EN .
COMPUTERS & CHEMICAL ENGINEERING, 1998, 22 (4-5) :647-671
[2]   A finite branch-and-bound algorithm for two-stage stochastic integer programs [J].
Ahmed, S ;
Tawarmalani, M ;
Sahinidis, NV .
MATHEMATICAL PROGRAMMING, 2004, 100 (02) :355-377
[3]   Randomized methods for design of uncertain systems: Sample complexity and sequential algorithms [J].
Alamo, Teodoro ;
Tempo, Roberto ;
Luque, Amalia ;
Ramirez, Daniel R. .
AUTOMATICA, 2015, 52 :160-172
[4]   Randomized Strategies for Probabilistic Solutions of Uncertain Feasibility and Optimization Problems [J].
Alamo, Teodoro ;
Tempo, Roberto ;
Camacho, Eduardo F. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2009, 54 (11) :2545-2559
[5]  
[Anonymous], DATA DRIVEN DISTRIBU
[6]  
[Anonymous], MANAG SCI
[7]  
[Anonymous], 2015, Nature, DOI [10.1038/nature14539, DOI 10.1038/NATURE14539]
[8]  
[Anonymous], IEEE T AUTOM CONTROL
[9]  
[Anonymous], 2017, COMMUN ACM, DOI DOI 10.1145/3065386
[10]  
[Anonymous], BIG DATA REVOLUTION