Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-10T15:33:14.808Z Has data issue: false hasContentIssue false

Approximation of the difference of two Poisson-like counts by Skellam

Published online by Cambridge University Press:  26 July 2018

H. L. Gan*
Affiliation:
Northwestern University
Eric D. Kolaczyk*
Affiliation:
Boston University
*
* Postal address: Mathematics Department, Northwestern University, 2033 Sheridan Road, Evanston, IL 60208, USA. Email address: ganhl@math.northwestern.edu
** Postal address: Department of Mathematics and Statistics, Boston University, 111 Cummington Mall, Boston, MA 02215, USA. Email address: kolaczyk@bu.edu

Abstract

Poisson-like behavior for event count data is ubiquitous in nature. At the same time, differencing of such counts arises in the course of data processing in a variety of areas of application. As a result, the Skellam distribution – defined as the distribution of the difference of two independent Poisson random variables – is a natural candidate for approximating the difference of Poisson-like event counts. However, in many contexts strict independence, whether between counts or among events within counts, is not a tenable assumption. Here we characterize the accuracy in approximating the difference of Poisson-like counts by a Skellam random variable. Our results fully generalize existing, more limited, results in this direction and, at the same time, our derivations are significantly more concise and elegant. We illustrate the potential impact of these results in the context of problems from network analysis and image processing, where various forms of weak dependence can be expected.

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1]Abramowitz, M. and Stegun, I. A. (1964). Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables (Nat. Bureau Standards Appl. Math. Ser. 55). U.S. Government Printing Office, Washington, D.C.Google Scholar
[2]Altmann, A.et al. (2011). VipR: variant identification in pooled DNA using R. Bioinformatics 27, 7784. Google Scholar
[3]Athiray, P. S., Sreekumar, P., Narendranath, S. and Gow, J. P. D. (2015). Simulating charge transport to understand the spectral response of swept charge devices. Astronomy Astrophys. 583, A97. Google Scholar
[4]Balachandran, P., Kolaczyk, E. D. and Viles, W. D. (2017). On the propagation of low-rate measurement error to subgraph counts in large networks. J. Mach. Learn. Res. 18, 61. Google Scholar
[5]Barbour, A. D. (1982). Poisson convergence and random graphs. Math. Proc. Camb. Philos. Soc. 92, 349359. Google Scholar
[6]Barbour, A. D. (1988). Stein's method and Poisson process convergence. In A Celebration of Applied Probability (J. Appl. Prob. Spec. Vol. 25A), Applied Probability Trust, Sheffield, pp. 175184. Google Scholar
[7]Barbour, A. D. (2005). Multivariate Poisson-binomial approximation using Stein's method. In Stein's Method and Applications (Lect. Notes Ser. Inst. Math. Sci. Nat. Univ. Singap. 5), Singapore University Press, pp. 131142. Google Scholar
[8]Barbour, A. D., Holst, L. and Janson, S. (1992). Poisson Approximation (Oxford Studies Prob. 2). Oxford University Press. Google Scholar
[9]Barbour, A. D., Karoński, M. and Ruciński, A. (1989). A central limit theorem for decomposable random variables with applications to random graphs. J. Combin. Theory B 47, 125145. Google Scholar
[10]Brown, T. C. and Xia, A.-H. (1995). On Stein-Chen factors for Poisson approximation. Statist. Prob. Lett. 23, 327332. Google Scholar
[11]Brown, T. C. and Xia, A. (2001). Stein's method and birth-death processes. Ann. Prob. 29, 13731403. Google Scholar
[12]Bzdak, A., Koch, V. and Skokov, V. (2013). Baryon number conservation and the cumulants of the net proton distribution. Phys. Rev. C 87, 014901. Google Scholar
[13]Cesarelli, M.et al. (2013). X-ray fluoroscopy noise modeling for filter design. Internat. J. Comput. Assisted Radiology Surgery 8, 269278. Google Scholar
[14]Hirakawa, K. and Wolfe, P. J. (2012). Skellam shrinkage: wavelet-based intensity estimation for inhomogeneous Poisson data. IEEE Trans. Inf. Theory 58, 10801093. Google Scholar
[15]Hoel, P. G., Port, S. C. and Stone, C. J. (1972). Introduction to Stochastic Processes. Houghton Mifflin, Boston, MA. Google Scholar
[16]Hwang, Y., Kim, J.-S. and Kweon, I.-S. (2007). Sensor noise modeling using the Skellam distribution: application to the color edge detection. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2007, IEEE. Google Scholar
[17]Jackson, M. O. (2008). Social and Economic Networks. Princeton University Press. Google Scholar
[18]Janson, S., Łuczak, T. and Rucinski, A. (2000). Random Graphs. John Wiley, New York. Google Scholar
[19]Kolaczyk, E. D. (2009). Statistical Analysis of Network Data: Methods and Models. Springer, New York. Google Scholar
[20]Mallat, S. (1998). A Wavelet Tour of Signal Processing. Academic Press, San Diego, CA. Google Scholar
[21]Morita, K., Friman, B., Redlich, K. and Skokov, V. (2013). Net quark number probability distribution near the chiral crossover transition. Phys. Rev. C 88, 034903. Google Scholar
[22]Newman, M. E. J. (2010). Networks: An Introduction. Oxford University Press. Google Scholar
[23]Shin, H.-C.et al. (2010). Neural decoding of finger movements using Skellam-based maximum-likelihood decoding. IEEE Trans. Biomed. Eng. 57, 754760. Google Scholar
[24]Skellam, J. G. (1946). The frequency distribution of the difference between two Poisson variates belonging to different populations. J. R. Statist. Soc. (N.S.) 109, 296. Google Scholar
[25]Townsley, L. K., Broos, P. S., Garmire, G. P. and Nousek, J. A. (2000). Mitigating charge transfer inefficiency in the Chandra x-ray observatory advanced CCD imaging spectrometer. Astrophys. J. Lett. 534, L139. Google Scholar