Representing piecewise linear functions by functions with small arity

被引:0
作者
Koutschan, Christoph [1 ]
Moser, Bernhard [2 ]
Ponomarchuk, Anton [1 ]
Schicho, Josef [3 ]
机构
[1] Johann Radon Inst Computat & Appl Math RICAM, Linz, Austria
[2] Software Competence Ctr Hagenberg SCCH, Hagenberg, Austria
[3] Johannes Kepler Univ JKU, Res Inst Symbol Computat RISC, Linz, Austria
关键词
Piecewise linear function; Linear combination of max-functions; ReLU network; Convex polyhedra; Minkowski sum; Zero volume polytope;
D O I
10.1007/s00200-023-00627-1
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A piecewise linear function can be described in different forms: as a nested expression of min - and max-functions, as a difference of two convex piecewise linear functions, or as a linear combination of maxima of affine-linear functions. In this paper, we provide two main results: first, we show that for every piecewise linear function f : R-n -> R, there exists a linear combination of max-functions with at most n + 1 arguments, and give an algorithm for its computation. Moreover, these arguments are contained in the finite set of affine-linear functions that coincide with the given function in some open set. Second, we prove that the piecewise linear function max(0, x(1),., x(n)) cannot be represented as a linear combination of maxima of less than n + 1 affine-linear arguments. This was conjectured by Wang and Sun (IEEE Trans Inf Theory 51:4425-4431, 2005) in a paper on representations of piecewise linear functions as linear combination of maxima.
引用
收藏
页码:595 / 610
页数:16
相关论文
共 12 条
[11]   Region configurations for realizability of lattice piecewise-linear models [J].
Tarela, JM ;
Martínez, MV .
MATHEMATICAL AND COMPUTER MODELLING, 1999, 30 (11-12) :17-27
[12]   Generalization of hinging hyperplanes [J].
Wang, SN ;
Sun, XS .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (12) :4425-4431