A simple and fast method for computing the Poisson binomial distribution function

被引:20
作者
Biscarri, William [1 ]
Zhao, Sihai Dave [1 ]
Brunner, Robert J. [1 ,2 ,3 ,4 ]
机构
[1] Univ Illinois, Dept Stat, Urbana, IL USA
[2] Univ Illinois, Dept Accountancy, Urbana, IL USA
[3] Univ Illinois, Dept Informat Sci, Urbana, IL USA
[4] Natl Ctr Supercomp Applicat, Urbana, IL USA
基金
美国国家科学基金会;
关键词
Poisson binomial; Convolution; Fourier transform; Independent Bernoulli sum; CENTRAL-LIMIT-THEOREM; APPROXIMATION; SUCCESSES; NUMBER; RELIABILITY; REFINEMENT; ALGORITHM; SUMS;
D O I
10.1016/j.csda.2018.01.007
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
It is shown that the Poisson binomial distribution function can be efficiently calculated using simple convolution based methods. The Poisson binomial distribution describes how the sum of independent but not identically distributed Bernoulli random variables is distributed. Due to the intractability of the Poisson binomial distribution function, efficient methods for computing it have been of particular interest in past Statistical literature. First, it is demonstrated that simply and directly using the definition of the distribution function of a sum of random variables can calculate the Poisson binomial distribution function efficiently. A modified, tree structured Fourier transform convolution scheme is then presented, which provides even greater gains in efficiency. Both approaches are shown to outperform the current state of the art methods in terms of accuracy and speed. The methods are then evaluated on a real data image processing example in order to demonstrate the efficiency advantages of the proposed methods in practical cases. Finally, possible extensions for using convolution based methods to calculate other distribution functions are discussed. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:92 / 100
页数:9
相关论文
共 37 条
[11]   AN ALGORITHM FOR MACHINE CALCULATION OF COMPLEX FOURIER SERIES [J].
COOLEY, JW ;
TUKEY, JW .
MATHEMATICS OF COMPUTATION, 1965, 19 (90) :297-&
[12]   On the assessment of reliability in probabilistic hydrometeorological event forecasting [J].
DeChant, Caleb M. ;
Moradkhani, Hamid .
WATER RESOURCES RESEARCH, 2015, 51 (06) :3867-3883
[13]   A SEMIGROUP APPROACH TO POISSON APPROXIMATION [J].
DEHEUVELS, P ;
PFEIFER, D .
ANNALS OF PROBABILITY, 1986, 14 (02) :663-676
[14]   BINOMIAL APPROXIMATION TO THE POISSON BINOMIAL-DISTRIBUTION [J].
EHM, W .
STATISTICS & PROBABILITY LETTERS, 1991, 11 (01) :7-16
[15]  
Elmore R, HOT HAND PGA TOUR DO
[16]   Closed-Form Expression for the Poisson-Binomial Probability Density Function [J].
Fernandez, Manuel ;
Williams, Stuart .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2010, 46 (02) :803-817
[17]   The design and implementation of FFTW3 [J].
Frigo, M ;
Johnson, SG .
PROCEEDINGS OF THE IEEE, 2005, 93 (02) :216-231
[18]   FASTER INTEGER MULTIPLICATION [J].
Fuerer, Martin .
SIAM JOURNAL ON COMPUTING, 2009, 39 (03) :979-1005
[19]   A Note on the Poisson's Binomial Distribution in Item Response Theory [J].
Gonzalez, Jorge ;
Wiberg, Marie ;
von Davier, Alina A. .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2016, 40 (04) :302-310
[20]   ON THE DISTRIBUTION OF THE NUMBER OF SUCCESSES IN INDEPENDENT TRIALS [J].
HOEFFDING, W .
ANNALS OF MATHEMATICAL STATISTICS, 1956, 27 (03) :713-721