A simple and fast method for computing the Poisson binomial distribution function

被引:20
作者
Biscarri, William [1 ]
Zhao, Sihai Dave [1 ]
Brunner, Robert J. [1 ,2 ,3 ,4 ]
机构
[1] Univ Illinois, Dept Stat, Urbana, IL USA
[2] Univ Illinois, Dept Accountancy, Urbana, IL USA
[3] Univ Illinois, Dept Informat Sci, Urbana, IL USA
[4] Natl Ctr Supercomp Applicat, Urbana, IL USA
基金
美国国家科学基金会;
关键词
Poisson binomial; Convolution; Fourier transform; Independent Bernoulli sum; CENTRAL-LIMIT-THEOREM; APPROXIMATION; SUCCESSES; NUMBER; RELIABILITY; REFINEMENT; ALGORITHM; SUMS;
D O I
10.1016/j.csda.2018.01.007
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
It is shown that the Poisson binomial distribution function can be efficiently calculated using simple convolution based methods. The Poisson binomial distribution describes how the sum of independent but not identically distributed Bernoulli random variables is distributed. Due to the intractability of the Poisson binomial distribution function, efficient methods for computing it have been of particular interest in past Statistical literature. First, it is demonstrated that simply and directly using the definition of the distribution function of a sum of random variables can calculate the Poisson binomial distribution function efficiently. A modified, tree structured Fourier transform convolution scheme is then presented, which provides even greater gains in efficiency. Both approaches are shown to outperform the current state of the art methods in terms of accuracy and speed. The methods are then evaluated on a real data image processing example in order to demonstrate the efficiency advantages of the proposed methods in practical cases. Finally, possible extensions for using convolution based methods to calculate other distribution functions are discussed. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:92 / 100
页数:9
相关论文
共 37 条
[1]   COMPUTING K-OUT-OF-N SYSTEM RELIABILITY [J].
BARLOW, RE ;
HEIDTMANN, KD .
IEEE TRANSACTIONS ON RELIABILITY, 1984, 33 (04) :322-323
[2]   AN O(N-CENTER-DOT(LOG(2)(N))(2)) ALGORITHM FOR COMPUTING THE RELIABILITY OF K-OUT-OF-N-G AND K-TO-L-OUT-OF-N-G SYSTEMS [J].
BELFORE, LA .
IEEE TRANSACTIONS ON RELIABILITY, 1995, 44 (01) :132-136
[3]   The accuracy of the Gaussian approximation to the sum of independent variates [J].
Berry, Andrew C. .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1941, 49 (1-3) :122-136
[4]  
Bishop Christopher M, 2016, Pattern recognition and machine learning
[5]  
Brost R. C, 2014, P 3 ACM SIGSPATIAL I, P1
[6]   Stacking species distribution models and adjusting bias by linking them to macroecological models [J].
Calabrese, Justin M. ;
Certain, Gregoire ;
Kraan, Casper ;
Dormann, Carsten F. .
GLOBAL ECOLOGY AND BIOGEOGRAPHY, 2014, 23 (01) :99-112
[7]   CONVERGENCE OF POISSON BINOMIAL TO POISSON DISTRIBUTIONS [J].
CHEN, LHY .
ANNALS OF PROBABILITY, 1974, 2 (01) :178-180
[8]  
Chen SX, 1997, STAT SINICA, V7, P875
[9]  
CHEN XH, 1994, BIOMETRIKA, V81, P457
[10]  
Choi KP, 2002, ANN APPL PROBAB, V12, P1139