Large Deviation Bounds for Decision Trees and Sampling Lower Bounds for AC0-circuits

被引:6
作者
Beck, Chris [1 ]
Impagliazzo, Russell [2 ]
Lovett, Shachar [2 ]
机构
[1] Princeton Univ, Princeton, NJ 08544 USA
[2] Inst Adv Study, Princeton, NJ USA
来源
2012 IEEE 53RD ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS) | 2012年
基金
美国国家科学基金会;
关键词
Small depth circuits; Lower Bounds; Sampling Distributions; Concentration Bounds; CIRCUITS;
D O I
10.1109/FOCS.2012.82
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
There has been considerable interest lately in the complexity of distributions. Recently, Lovett and Viola (CCC 2011) showed that the statistical distance between a uniform distribution over a good code, and any distribution which can be efficiently sampled by a small bounded-depth AC(0) circuit, is inverse-polynomially close to one. That is, such distributions are very far from each other. We strengthen their result, and show that the distance is in fact exponentially close to one. This allows us to strengthen the parameters in their application for data structure lower bounds for succinct data structures for codes. From a technical point of view, we develop new large deviation bounds for functions computed by small depth decision trees, which we then apply to obtain bounds for AC(0) circuits via the switching lemma. We show that if such functions are Lipschitz on average in a certain sense, then they are in fact Lipschitz almost everywhere. This type of result falls into the extensive line of research which studies large deviation bounds for the sum of random variables, where while not independent, exhibit large deviation bounds similar to these obtained by independent random variables.
引用
收藏
页码:101 / 110
页数:10
相关论文
共 18 条
[1]   SIGMA-11-FORMULAE ON FINITE STRUCTURES [J].
AJTAI, M .
ANNALS OF PURE AND APPLIED LOGIC, 1983, 24 (01) :1-48
[2]  
Alon N., 1992, The Probabilistic Method
[3]  
Beame Paul, 1994, UWCSE950701
[4]   PARITY, CIRCUITS, AND THE POLYNOMIAL-TIME HIERARCHY [J].
FURST, M ;
SAXE, JB ;
SIPSER, M .
MATHEMATICAL SYSTEMS THEORY, 1984, 17 (01) :13-27
[5]   ON THE IMPLEMENTATION OF HUGE RANDOM OBJECTS [J].
Goldreich, Oded ;
Goldwasser, Shafi ;
Nussboim, Asaf .
SIAM JOURNAL ON COMPUTING, 2010, 39 (07) :2761-2822
[6]  
Hastad Johan, 1986, P 18 ANN ACM S THEOR, P6
[7]   APPROXIMATING THE PERMANENT [J].
JERRUM, M ;
SINCLAIR, A .
SIAM JOURNAL ON COMPUTING, 1989, 18 (06) :1149-1178
[8]   RANDOM GENERATION OF COMBINATORIAL STRUCTURES FROM A UNIFORM-DISTRIBUTION [J].
JERRUM, MR ;
VALIANT, LG ;
VAZIRANI, VV .
THEORETICAL COMPUTER SCIENCE, 1986, 43 (2-3) :169-188
[9]   Concentration of multivariate polynomials and its applications [J].
Kim, JH ;
Vu, VH .
COMBINATORICA, 2000, 20 (03) :417-434
[10]   CONSTANT DEPTH CIRCUITS, FOURIER-TRANSFORM, AND LEARNABILITY [J].
LINIAL, N ;
MANSOUR, Y ;
NISAN, N .
JOURNAL OF THE ACM, 1993, 40 (03) :607-620