Online Mixed-Integer Optimization in Milliseconds

被引:32
作者
Bertsimas, Dimitris [1 ,2 ]
Stellato, Bartolomeo [3 ]
机构
[1] MIT, Operat Res Ctr, Cambridge, MA 02139 USA
[2] MIT, Sloan Sch Management, Cambridge, MA 02139 USA
[3] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
关键词
mixed-integer optimization; computational methods; artificial intelligence; analysis of algorithms: computational complexity; heuristic; MODEL-PREDICTIVE CONTROL; ALGORITHM;
D O I
10.1287/ijoc.2022.1181
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose a method to approximate the solution of online mixed-integer optimization (MIO) problems at very high speed using machine learning. By exploiting the repetitive nature of online optimization, we can greatly speed up the solution time. Our approach encodes the optimal solution into a small amount of information denoted as strategy using the voice of optimization framework. In this way, the core part of the optimization routine becomes a multiclass classification problem that can be solved very quickly. In this work, we extend that framework to real-time and high-speed applications focusing on parametric mixed-integer quadratic optimization. We propose an extremely fast online optimization method consisting of a feedforward neural network evaluation and a linear system solution where the matrix has already been factorized. Therefore, this online approach does not require any solver or iterative algorithm. We show the speed of the proposed method both in terms of total computations required and measured execution time. We estimate the number of floating point operations required to completely recover the optimal solution as a function of the problem dimensions. Compared with state-of-the-art MIO routines, the online running time of our method is very predictable and can be lower than a single matrix factorization time. We benchmark our method against the state-of-the-art solver Gurobi obtaining up to two to three orders of magnitude speedups on examples from fuel cell energy management, sparse portfolio optimization, and motion planning with obstacle avoidance.
引用
收藏
页码:2229 / 2248
页数:20
相关论文
共 66 条
[21]  
Dai HJ, 2016, PR MACH LEARN RES, V48
[22]   Lattice code decoder for space-time codes [J].
Damen, O ;
Chkeif, A ;
Belfiore, JC .
IEEE COMMUNICATIONS LETTERS, 2000, 4 (05) :161-163
[23]  
Davis TA, 2006, FUND ALGORITHMS, V2, P27
[24]   A general system for heuristic minimization of convex functions over non-convex sets [J].
Diamond, S. ;
Takapoui, R. ;
Boyd, S. .
OPTIMIZATION METHODS & SOFTWARE, 2018, 33 (01) :165-193
[25]  
Diamond S, 2016, J MACH LEARN RES, V17
[26]   Real-time optimization and nonlinear model predictive control of processes governed by differential-algebraic equations [J].
Diehl, M ;
Bock, HG ;
Schlöder, JP ;
Findeisen, R ;
Nagy, Z ;
Allgöwer, F .
JOURNAL OF PROCESS CONTROL, 2002, 12 (04) :577-585
[27]  
Domahidi A, 2013, 2013 EUROPEAN CONTROL CONFERENCE (ECC), P3077
[28]  
Falcon W., 2019, PyTorch Lightning
[29]   An online active set strategy to overcome the limitations of explicit MPC [J].
Ferreau, H. J. ;
Bock, H. G. ;
Diehl, M. .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2008, 18 (08) :816-830
[30]   qpOASES: a parametric active-set algorithm for quadratic programming [J].
Ferreau, Hans Joachim ;
Kirches, Christian ;
Potschka, Andreas ;
Bock, Hans Georg ;
Diehl, Moritz .
MATHEMATICAL PROGRAMMING COMPUTATION, 2014, 6 (04) :327-363