Generatinn optimal robust continuous piecewise linear regression with outliers through combinatorial Benders decomposition

被引:5
|
作者
Warwicker, John Alasdair [1 ]
Rebennack, Steffen [1 ]
机构
[1] Karlsruhe Inst Technol, Inst Operat Res, Stochast Optimizat, Karlsruhe, Germany
关键词
Piecewise linear function; combinatorial Benders decomposition; mixed-integer linear programming (MILP); function fitting; outlier detection; APPROXIMATION; ALGORITHMS; MODELS;
D O I
10.1080/24725854.2022.2107249
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Using piecewise linear (PWL) functions to model discrete data has applications for example in healthcare, engineering and pattern recognition. Recently, mixed-integer linear programming (MILP) approaches have been used to optimally fit continuous PWL functions. We extend these formulations to allow for outliers. The resulting MILP models rely on binary variables and big-M constructs to model logical implications. The combinatorial Benders decomposition (CBD) approach removes the dependency on the big-M constraints by separating the MILP model into a master problem of the complicating binary variables and a linear sub problem over the continuous variables, which feeds combinatorial solution information into the master problem. We use the CBD approach to decompose the proposed MILP model and solve for optimal PWL functions. Computational results show that vast speedups can be found using this robust approach, with problem-specific improvements including smart initialization, strong cut generation and special branching approaches leading to even faster solve times, up to more than 12,000 times faster than the standard MILP approach.
引用
收藏
页码:755 / 767
页数:13
相关论文
共 50 条
  • [1] Robust continuous piecewise linear regression model with multiple change points
    Shurong Shi
    Yi Li
    Chuang Wan
    The Journal of Supercomputing, 2020, 76 : 3623 - 3645
  • [2] Robust continuous piecewise linear regression model with multiple change points
    Shi, Shurong
    Li, Yi
    Wan, Chuang
    JOURNAL OF SUPERCOMPUTING, 2020, 76 (05): : 3623 - 3645
  • [3] Asymptotic Characterisation of the Performance of Robust Linear Regression in the Presence of Outliers
    Vilucchio, Matteo
    Troiani, Emanuele
    Erba, Vittorio
    Krzakala, Florent
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [4] New robust ridge estimators for the linear regression model with outliers
    Majid, Abdul
    Amin, Muhammad
    Aslam, Muhammad
    Ahmad, Shakeel
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2023, 52 (10) : 4717 - 4738
  • [5] Optimal Piecewise Linear Regression Algorithm for QSAR Modelling
    Cardoso-Silva, Jonathan
    Papadatos, George
    Papageorgiou, Lazaros G.
    Tsoka, Sophia
    MOLECULAR INFORMATICS, 2019, 38 (03)
  • [6] Using robust scale estimates in detecting multiple outliers in linear regression
    Swallow, WH
    Kianifard, F
    BIOMETRICS, 1996, 52 (02) : 545 - 556
  • [8] Optimal Learning in Linear Regression with Combinatorial Feature Selection
    Han, Bin
    Ryzhov, Ilya O.
    Defourny, Boris
    INFORMS JOURNAL ON COMPUTING, 2016, 28 (04) : 721 - 735
  • [9] An algorithm for the estimation of a regression function by continuous piecewise linear functions
    Adil Bagirov
    Conny Clausen
    Michael Kohler
    Computational Optimization and Applications, 2010, 45 : 159 - 179
  • [10] An algorithm for the estimation of a regression function by continuous piecewise linear functions
    Bagirov, Adil
    Clausen, Conny
    Kohler, Michael
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2010, 45 (01) : 159 - 179