Online Mixed-Integer Optimization in Milliseconds

被引:32
作者
Bertsimas, Dimitris [1 ,2 ]
Stellato, Bartolomeo [3 ]
机构
[1] MIT, Operat Res Ctr, Cambridge, MA 02139 USA
[2] MIT, Sloan Sch Management, Cambridge, MA 02139 USA
[3] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
关键词
mixed-integer optimization; computational methods; artificial intelligence; analysis of algorithms: computational complexity; heuristic; MODEL-PREDICTIVE CONTROL; ALGORITHM;
D O I
10.1287/ijoc.2022.1181
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose a method to approximate the solution of online mixed-integer optimization (MIO) problems at very high speed using machine learning. By exploiting the repetitive nature of online optimization, we can greatly speed up the solution time. Our approach encodes the optimal solution into a small amount of information denoted as strategy using the voice of optimization framework. In this way, the core part of the optimization routine becomes a multiclass classification problem that can be solved very quickly. In this work, we extend that framework to real-time and high-speed applications focusing on parametric mixed-integer quadratic optimization. We propose an extremely fast online optimization method consisting of a feedforward neural network evaluation and a linear system solution where the matrix has already been factorized. Therefore, this online approach does not require any solver or iterative algorithm. We show the speed of the proposed method both in terms of total computations required and measured execution time. We estimate the number of floating point operations required to completely recover the optimal solution as a function of the problem dimensions. Compared with state-of-the-art MIO routines, the online running time of our method is very predictable and can be lower than a single matrix factorization time. We benchmark our method against the state-of-the-art solver Gurobi obtaining up to two to three orders of magnitude speedups on examples from fuel cell energy management, sparse portfolio optimization, and motion planning with obstacle avoidance.
引用
收藏
页码:2229 / 2248
页数:20
相关论文
共 66 条
[1]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[2]   A Machine Learning-Based Approximation of Strong Branching [J].
Alvarez, Alejandro Marcos ;
Louveaux, Quentin ;
Wehenkel, Louis .
INFORMS JOURNAL ON COMPUTING, 2017, 29 (01) :185-195
[3]  
[Anonymous], 2016, PREPRINT
[4]  
Banjac G, 2017, IEEE DECIS CONTR P
[5]   The explicit linear quadratic regulator for constrained systems [J].
Bemporad, A ;
Morari, M ;
Dua, V ;
Pistikopoulos, EN .
AUTOMATICA, 2002, 38 (01) :3-20
[6]   Control of systems integrating logic, dynamics, and constraints [J].
Bemporad, A ;
Morari, M .
AUTOMATICA, 1999, 35 (03) :407-427
[7]   Machine learning for combinatorial optimization: A methodological tour d'horizon [J].
Bengio, Yoshua ;
Lodi, Andrea ;
Prouvost, Antoine .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 290 (02) :405-421
[8]   Robust multiperiod portfolio management in the presence of transaction costs [J].
Bertsimas, Dimitris ;
Pachamanova, Dessislava .
COMPUTERS & OPERATIONS RESEARCH, 2008, 35 (01) :3-17
[9]   The voice of optimization [J].
Bertsimas, Dimitris ;
Stellato, Bartolomeo .
MACHINE LEARNING, 2021, 110 (02) :249-277
[10]  
Bertsimas Dimitris, 2005, Optimization Over Integers