Representing piecewise linear functions by functions with small arity

被引:0
作者
Koutschan, Christoph [1 ]
Moser, Bernhard [2 ]
Ponomarchuk, Anton [1 ]
Schicho, Josef [3 ]
机构
[1] Johann Radon Inst Computat & Appl Math RICAM, Linz, Austria
[2] Software Competence Ctr Hagenberg SCCH, Hagenberg, Austria
[3] Johannes Kepler Univ JKU, Res Inst Symbol Computat RISC, Linz, Austria
关键词
Piecewise linear function; Linear combination of max-functions; ReLU network; Convex polyhedra; Minkowski sum; Zero volume polytope;
D O I
10.1007/s00200-023-00627-1
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A piecewise linear function can be described in different forms: as a nested expression of min - and max-functions, as a difference of two convex piecewise linear functions, or as a linear combination of maxima of affine-linear functions. In this paper, we provide two main results: first, we show that for every piecewise linear function f : R-n -> R, there exists a linear combination of max-functions with at most n + 1 arguments, and give an algorithm for its computation. Moreover, these arguments are contained in the finite set of affine-linear functions that coincide with the given function in some open set. Second, we prove that the piecewise linear function max(0, x(1),., x(n)) cannot be represented as a linear combination of maxima of less than n + 1 affine-linear arguments. This was conjectured by Wang and Sun (IEEE Trans Inf Theory 51:4425-4431, 2005) in a paper on representations of piecewise linear functions as linear combination of maxima.
引用
收藏
页码:595 / 610
页数:16
相关论文
共 12 条
[1]  
[Anonymous], 2002, Contrib. Algebra Geom.
[2]  
Arora Raman, 2018, ICLR
[3]   CANONICAL PIECEWISE-LINEAR REPRESENTATION [J].
CHUA, LO ;
DENG, AC .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1988, 35 (01) :101-111
[4]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
[5]   MINKOWSKI ADDITION OF POLYTOPES - COMPUTATIONAL-COMPLEXITY AND APPLICATIONS TO GROBNER BASES [J].
GRITZMANN, P ;
STURMFELS, B .
SIAM JOURNAL ON DISCRETE MATHEMATICS, 1993, 6 (02) :246-269
[6]  
Hertrich C., 2021, Advances in Neural Information Processing Systems, V34, P3336
[7]  
Kripfganz A., 1987, Optimization, V18, P23, DOI 10.1080/02331938708843210
[8]   Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums [J].
Montufar, Guido ;
Ren, Yue ;
Zhang, Leon .
SIAM JOURNAL ON APPLIED ALGEBRA AND GEOMETRY, 2022, 6 (04) :618-649
[9]  
Nair V., 2010, P 27 INT C MACH LEAR, P807, DOI DOI 10.1145/1390156.1390224
[10]  
Schluter N., 2020, P 21 IFAC WORLD C