Approximation with One-Bit Polynomials in Bernstein Form

We prove various theorems on approximation using polynomials with integer coefficients in the Bernstein basis of any given order. In the extreme, we draw the coefficients from {+/- 1} only. A basic case of our results states that for any Lipschitz function f : [0,1] -> [-1,1] and for any positive integer n, there are signs sigma(0), ...,sigma(n)is an element of{+/- 1} such that vertical bar f(x)-Sigma(n)(k=0)sigma(k)((n)(k))x(k)(1-x)(n-k)vertical bar <= C(1+vertical bar f vertical bar(Lip))/1+root nx(1-x) for all x is an element of [0,1]. More generally, we show that higher accuracy is achievable for smoother functions: For any integer s >= 1, if f has a Lipschitz (s-1)st derivative, then approximation accuracy of order O(n(-s/2)) is achievable with coefficients in {+/- 1} provided parallel to f parallel to(infinity) < 1, and of order O(n(-s)) with unrestricted integer coefficients, both uniformly on closed subintervals of (0,1) as above. Hence these polynomial approximations are not constrained by the saturation of classical Bernstein polynomials. Our approximations are constructive and can be implemented using feedforward neural networks whose weights are chosen from {+/- 1} only.