Poisson distribution

From testwiki
Revision as of 23:24, 25 January 2025 by imported>Omnipaedista (Wikipedia avoids unnecessary capitalization)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Template:Short description Template:Pp-semi-vandalism Template:Use dmy dates Template:Infobox probability distribution

In probability theory and statistics, the Poisson distribution (Template:IPAc-en) is a discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time if these events occur with a known constant mean rate and independently of the time since the last event.Template:R It can also be used for the number of events in other types of intervals than time, and in dimension greater than 1 (e.g., number of events in a given area or volume).

The Poisson distribution is named after French mathematician Siméon Denis Poisson. It plays an important role for discrete-stable distributions.

Under a Poisson distribution with the expectation of λ events in a given interval, the probability of k events in the same interval is:Template:R

λkeλk!.

For instance, consider a call center which receives an average of λ = 3 calls per minute at all times of day. If the calls are independent, receiving one does not change the probability of when the next one will arrive. Under these assumptions, the number k of calls received during any minute has a Poisson probability distribution. Receiving k = 1 to 4 calls then has a probability of about 0.77, while receiving 0 or at least 5 calls has a probability of about 0.23.

A classic example used to motivate the Poisson distribution is the number of radioactive decay events during a fixed observation period.[1]

History

The distribution was first introduced by Siméon Denis Poisson (1781–1840) and published together with his probability theory in his work Recherches sur la probabilité des jugements en matière criminelle et en matière civile (1837).Template:R The work theorized about the number of wrongful convictions in a given country by focusing on certain random variables Template:Mvar that count, among other things, the number of discrete occurrences (sometimes called "events" or "arrivals") that take place during a time-interval of given length. The result had already been given in 1711 by Abraham de Moivre in De Mensura Sortis seu; de Probabilitate Eventuum in Ludis a Casu Fortuito Pendentibus .Template:RTemplate:RTemplate:RTemplate:R This makes it an example of Stigler's law and it has prompted some authors to argue that the Poisson distribution should bear the name of de Moivre.Template:R

In 1860, Simon Newcomb fitted the Poisson distribution to the number of stars found in a unit of space.Template:R A further practical application was made by Ladislaus Bortkiewicz in 1898. Bortkiewicz showed that the frequency with which soldiers in the Prussian army were accidentally killed by horse kicks could be well modeled by a Poisson distribution.Template:R.

Definitions

Probability mass function

A discrete random variable Template:Mvar is said to have a Poisson distribution with parameter λ>0 if it has a probability mass function given by:Template:R

f(k;λ)=Pr(X=k)=λkeλk!,

where

The positive real number Template:Mvar is equal to the expected value of Template:Mvar and also to its variance.[2]

λ=E(X)=Var(X).

The Poisson distribution can be applied to systems with a large number of possible events, each of which is rare. The number of such events that occur during a fixed time interval is, under the right circumstances, a random number with a Poisson distribution.

The equation can be adapted if, instead of the average number of events λ, we are given the average rate r at which events occur. Then λ=rt, and:[3]

P(k events in interval t)=(rt)kertk!.

Examples

Chewing gum on a sidewalk in Reykjavík.
Chewing gum on a sidewalk. The number of pieces on a single tile is approximately Poisson distributed.

The Poisson distribution may be useful to model events such as:

  • the number of meteorites greater than 1-meter diameter that strike Earth in a year;
  • the number of laser photons hitting a detector in a particular time interval;
  • the number of students achieving a low and high mark in an exam; and
  • locations of defects and dislocations in materials.

Examples of the occurrence of random points in space are: the locations of asteroid impacts with earth (2-dimensional), the locations of imperfections in a material (3-dimensional), and the locations of trees in a forest (2-dimensional).[4]

Assumptions and validity

The Poisson distribution is an appropriate model if the following assumptions are true:

  • Template:Mvar, a nonnegative integer, is the number of times an event occurs in an interval.
  • The occurrence of one event does not affect the probability of a second event.
  • The average rate at which events occur is independent of any occurrences.
  • Two events cannot occur at exactly the same instant.

If these conditions are true, then Template:Mvar is a Poisson random variable; the distribution of Template:Mvar is a Poisson distribution.

The Poisson distribution is also the limit of a binomial distribution, for which the probability of success for each trial equals Template:Mvar divided by the number of trials, as the number of trials approaches infinity (see Related distributions).

Examples of probability for Poisson distributions

Template:Col-begin Template:Col-break On a particular river, overflow floods occur once every 100 years on average. Calculate the probability of Template:Mvar = 0, 1, 2, 3, 4, 5, or 6 overflow floods in a 100-year interval, assuming the Poisson model is appropriate.

Because the average event rate is one overflow flood per 100 years, Template:Mvar = 1

P(k overflow floods in 100 years)=λkeλk!=1ke1k!
P(k=0 overflow floods in 100 years)=10e10!=e110.368
P(k=1 overflow flood in 100 years)=11e11!=e110.368
P(k=2 overflow floods in 100 years)=12e12!=e120.184

Template:Col-break

Template:Mvar Template:Mvar(Template:Mvar overflow floods in 100 years)
0 0.368
1 0.368
2 0.184
3 0.061
4 0.015
5 0.003
6 0.0005

The probability for 0 to 6 overflow floods in a 100-year period. Template:Col-end

Template:Col-begin Template:Col-break It has been reported that the average number of goals in a World Cup soccer match is approximately 2.5 and the Poisson model is appropriate.Template:R Because the average event rate is 2.5 goals per match, Template:Mvar = 2.5 .

P(k goals in a match)=2.5ke2.5k!
P(k=0 goals in a match)=2.50e2.50!=e2.510.082
P(k=1 goal in a match)=2.51e2.51!=2.5e2.510.205
P(k=2 goals in a match)=2.52e2.52!=6.25e2.520.257

Template:Col-break

Template:Mvar Template:Mvar(Template:Mvar goals in a World Cup soccer match)
0 0.082
1 0.205
2 0.257
3 0.213
4 0.133
5 0.067
6 0.028
7 0.010

The probability for 0 to 7 goals in a match. Template:Col-end

Once in an interval events: The special case of Template:Mvar = 1 and Template:Mvar = 0

Suppose that astronomers estimate that large meteorites (above a certain size) hit the earth on average once every 100 years (Template:Nobr event per 100 years), and that the number of meteorite hits follows a Poisson distribution. What is the probability of Template:Nobr meteorite hits in the next 100 years?

P(k=0 meteorites hit in next 100 years)=10e10!=1e0.37.

Under these assumptions, the probability that no large meteorites hit the earth in the next 100 years is roughly 0.37. The remaining Template:Nobr is the probability of 1, 2, 3, or more large meteorite hits in the next 100 years. In an example above, an overflow flood occurred once every 100 years Template:Nobr The probability of no overflow floods in 100 years was roughly 0.37, by the same calculation.

In general, if an event occurs on average once per interval (Template:Mvar = 1), and the events follow a Poisson distribution, then Template:Nobr In addition, Template:Nobr as shown in the table for overflow floods.

Examples that violate the Poisson assumptions

The number of students who arrive at the student union per minute will likely not follow a Poisson distribution, because the rate is not constant (low rate during class time, high rate between class times) and the arrivals of individual students are not independent (students tend to come in groups). The non-constant arrival rate may be modeled as a mixed Poisson distribution, and the arrival of groups rather than individual students as a compound Poisson process.

The number of magnitude 5 earthquakes per year in a country may not follow a Poisson distribution, if one large earthquake increases the probability of aftershocks of similar magnitude.

Examples in which at least one event is guaranteed are not Poisson distributed; but may be modeled using a zero-truncated Poisson distribution.

Count distributions in which the number of intervals with zero events is higher than predicted by a Poisson model may be modeled using a zero-inflated model.

Properties

Descriptive statistics

Median

Bounds for the median (ν) of the distribution are known and are sharp:Template:R λln2ν<λ+13.

Higher moments

The higher non-centered moments Template:MvarTemplate:Mvar of the Poisson distribution are Touchard polynomials in Template:Mvar: mk=i=0kλi{ki}, where the braces { } denote Stirling numbers of the second kind.Template:RTemplate:R In other words,E[X]=λ,E[X(X1)]=λ2,E[X(X1)(X2)]=λ3,When the expected value is set to λ = 1, Dobinski's formula implies that the Template:Mvar‑th moment is equal to the number of partitions of a set of size Template:Mvar.

A simple upper bound is:[5] mk=E[Xk](klog(k/λ+1))kλkexp(k22λ).

Sums of Poisson-distributed random variables

If XiPois(λi) for i=1,,n are independent, then i=1nXiPois(i=1nλi).Template:R A converse is Raikov's theorem, which says that if the sum of two independent random variables is Poisson-distributed, then so are each of those two independent random variables.Template:RTemplate:R

Maximum entropy

It is a maximum-entropy distribution among the set of generalized binomial distributions Bn(λ) with mean λ and n,[6] where a generalized binomial distribution is defined as a distribution of the sum of N independent but not identically distributed Bernoulli variables.

Other properties

  • The Poisson distributions are infinitely divisible probability distributions.Template:RTemplate:R
  • The directed Kullback–Leibler divergence of P=Pois(λ) from P0=Pois(λ0) is given by DKL(PP0)=λ0λ+λlogλλ0.
  • If λ1 is an integer, then YPois(λ) satisfies Pr(YE[Y])12 and Pr(YE[Y])12.[7]Template:Failed verification
  • Bounds for the tail probabilities of a Poisson random variable XPois(λ) can be derived using a Chernoff bound argument.Template:R P(Xx)(eλ)xeλxx, for x>λ, P(Xx)(eλ)xeλxx, for x<λ.
  • The upper tail probability can be tightened (by a factor of at least two) as follows:[8]

P(Xx)eDKL(QP)max(2,4πDKL(QP)), for x>λ, where DKL(QP) is the Kullback–Leibler divergence of Q=Pois(x) from P=Pois(λ).

  • Inequalities that relate the distribution function of a Poisson random variable XPois(λ) to the Standard normal distribution function Φ(x) are as follows:[9] Φ(sign(kλ)2DKL(QP))<P(Xk)<Φ(sign(k+1λ)2DKL(Q+P)), for k>0, where DKL(QP) is the Kullback–Leibler divergence of Q=Pois(k) from P=Pois(λ) and DKL(Q+P) is the Kullback–Leibler divergence of Q+=Pois(k+1) from P.

Poisson races

Let XPois(λ) and YPois(μ) be independent random variables, with λ<μ, then we have that e(μλ)2(λ+μ)2e(λ+μ)2λμe(λ+μ)4λμP(XY0)e(μλ)2

The upper bound is proved using a standard Chernoff bound.

The lower bound can be proved by noting that P(XY0X+Y=i) is the probability that Zi2, where ZBin(i,λλ+μ), which is bounded below by 1(i+1)2eiD(0.5λλ+μ), where D is relative entropy (See the entry on bounds on tails of binomial distributions for details). Further noting that X+YPois(λ+μ), and computing a lower bound on the unconditional probability gives the result. More details can be found in the appendix of Kamath et al.Template:R

As a Binomial distribution with infinitesimal time-steps

The Poisson distribution can be derived as a limiting case to the binomial distribution as the number of trials goes to infinity and the expected number of successes remains fixed — see law of rare events below. Therefore, it can be used as an approximation of the binomial distribution if Template:Mvar is sufficiently large and p is sufficiently small. The Poisson distribution is a good approximation of the binomial distribution if Template:Mvar is at least 20 and p is smaller than or equal to 0.05, and an excellent approximation if Template:Mvar ≥ 100 and Template:Mvar ≤ 10.Template:R Letting

FB

and

FP

be the respective cumulative density functions of the binomial and Poisson distributions, one has:

FB(k;n,p)  FP(k;λ=np).

One derivation of this uses probability-generating functions.[10] Consider a Bernoulli trial (coin-flip) whose probability of one success (or expected number of successes) is

λ1

within a given interval. Split the interval into n parts, and perform a trial in each subinterval with probability

λn

. The probability of k successes out of n trials over the entire interval is then given by the binomial distribution

pk(n)=(nk)(λn)k(1λn)nk,

whose generating function is:

P(n)(x)=k=0npk(n)xk=(1λn+λnx)n.

Taking the limit as n increases to infinity (with x fixed) and applying the product limit definition of the exponential function, this reduces to the generating function of the Poisson distribution:

limnP(n)(x)=limn(1+λ(x1)n)n=eλ(x1)=k=0eλλkk!xk.

General

Poisson approximation

Assume X1Pois(λ1),X2Pois(λ2),,XnPois(λn) where λ1+λ2++λn=1, then[11] (X1,X2,,Xn) is multinomially distributed (X1,X2,,Xn)Mult(N,λ1,λ2,,λn) conditioned on N=X1+X2+Xn.

This meansTemplate:R, among other things, that for any nonnegative function f(x1,x2,,xn), if (Y1,Y2,,Yn)Mult(m,𝐩) is multinomially distributed, then E[f(Y1,Y2,,Yn)]emE[f(X1,X2,,Xn)] where (X1,X2,,Xn)Pois(𝐩).

The factor of em can be replaced by 2 if f is further assumed to be monotonically increasing or decreasing.

Bivariate Poisson distribution

This distribution has been extended to the bivariate case.Template:R The generating function for this distribution is g(u,v)=exp[(θ1θ12)(u1)+(θ2θ12)(v1)+θ12(uv1)]

with θ1,θ2>θ12>0

The marginal distributions are Poisson(θ1) and Poisson(θ2) and the correlation coefficient is limited to the range 0ρmin{θ1θ2,θ2θ1}

A simple way to generate a bivariate Poisson distribution X1,X2 is to take three independent Poisson distributions Y1,Y2,Y3 with means λ1,λ2,λ3 and then set X1=Y1+Y3,X2=Y2+Y3. The probability function of the bivariate Poisson distribution is Pr(X1=k1,X2=k2)=exp(λ1λ2λ3)λ1k1k1!λ2k2k2!k=0min(k1,k2)(k1k)(k2k)k!(λ3λ1λ2)k

Free Poisson distribution

The free Poisson distribution[12] with jump size α and rate λ arises in free probability theory as the limit of repeated free convolution ((1λN)δ0+λNδα)N as Template:Math.

In other words, let XN be random variables so that XN has value α with probability λN and value 0 with the remaining probability. Assume also that the family X1,X2, are freely independent. Then the limit as N of the law of X1++XN is given by the Free Poisson law with parameters λ,α.

This definition is analogous to one of the ways in which the classical Poisson distribution is obtained from a (classical) Poisson process.

The measure associated to the free Poisson law is given by[13] μ={(1λ)δ0+ν,if 0λ1ν,if λ>1, where ν=12παt4λα2(tα(1+λ))2dt and has support [α(1λ)2,α(1+λ)2].

This law also arises in random matrix theory as the Marchenko–Pastur law. Its free cumulants are equal to κn=λαn.

Some transforms of this law

We give values of some important transforms of the free Poisson law; the computation can be found in e.g. in the book Lectures on the Combinatorics of Free Probability by A. Nica and R. Speicher[14]

The R-transform of the free Poisson law is given by R(z)=λα1αz.

The Cauchy transform (which is the negative of the Stieltjes transformation) is given by G(z)=z+αλα(zα(1+λ))24λα22αz

The S-transform is given by S(z)=1z+λ in the case that α=1.

Weibull and stable count

Poisson's probability mass function f(k;λ) can be expressed in a form similar to the product distribution of a Weibull distribution and a variant form of the stable count distribution. The variable (k+1) can be regarded as inverse of Lévy's stability parameter in the stable count distribution: f(k;λ)=01uWk+1(λu)[(k+1)uk𝔑1k+1(uk+1)]du, where 𝔑α(ν) is a standard stable count distribution of shape α=1/(k+1), and Wk+1(x) is a standard Weibull distribution of shape k+1.

Statistical inference

Template:See also

Parameter estimation

Given a sample of Template:Mvar measured values ki{0,1,}, for Template:Nobr we wish to estimate the value of the parameter Template:Mvar of the Poisson population from which the sample was drawn. The maximum likelihood estimate is[15]

λ^MLE=1ni=1nki .

Since each observation has expectation Template:Mvar so does the sample mean. Therefore, the maximum likelihood estimate is an unbiased estimator of Template:Mvar. It is also an efficient estimator since its variance achieves the Cramér–Rao lower bound (CRLB).[16] Hence it is minimum-variance unbiased. Also it can be proven that the sum (and hence the sample mean as it is a one-to-one function of the sum) is a complete and sufficient statistic for Template:Mvar.

To prove sufficiency we may use the factorization theorem. Consider partitioning the probability mass function of the joint Poisson distribution for the sample into two parts: one that depends solely on the sample 𝐱, called h(𝐱), and one that depends on the parameter λ and the sample 𝐱 only through the function T(𝐱). Then T(𝐱) is a sufficient statistic for λ.

P(𝐱)=i=1nλxieλxi!=1i=1nxi!×λi=1nxienλ

The first term h(𝐱) depends only on 𝐱. The second term g(T(𝐱)|λ) depends on the sample only through T(𝐱)=i=1nxi. Thus, T(𝐱) is sufficient.

To find the parameter Template:Mvar that maximizes the probability function for the Poisson population, we can use the logarithm of the likelihood function:

(λ)=lni=1nf(kiλ)=i=1nln(eλλkiki!)=nλ+(i=1nki)ln(λ)i=1nln(ki!).

We take the derivative of with respect to Template:Mvar and compare it to zero:

ddλ(λ)=0n+(i=1nki)1λ=0.

Solving for Template:Mvar gives a stationary point.

λ=i=1nkin

So Template:Mvar is the average of the Template:Mvari values. Obtaining the sign of the second derivative of L at the stationary point will determine what kind of extreme value Template:Mvar is.

2λ2=λ2i=1nki

Evaluating the second derivative at the stationary point gives:

2λ2=n2i=1nki

which is the negative of Template:Mvar times the reciprocal of the average of the ki. This expression is negative when the average is positive. If this is satisfied, then the stationary point maximizes the probability function.

For completeness, a family of distributions is said to be complete if and only if E(g(T))=0 implies that Pλ(g(T)=0)=1 for all λ. If the individual Xi are iid Po(λ), then T(𝐱)=i=1nXiPo(nλ). Knowing the distribution we want to investigate, it is easy to see that the statistic is complete.

E(g(T))=t=0g(t)(nλ)tenλt!=0

For this equality to hold, g(t) must be 0. This follows from the fact that none of the other terms will be 0 for all t in the sum and for all possible values of λ. Hence, E(g(T))=0 for all λ implies that Pλ(g(T)=0)=1, and the statistic has been shown to be complete.

Confidence interval

The confidence interval for the mean of a Poisson distribution can be expressed using the relationship between the cumulative distribution functions of the Poisson and chi-squared distributions. The chi-squared distribution is itself closely related to the gamma distribution, and this leads to an alternative expression. Given an observation Template:Mvar from a Poisson distribution with mean μ, a confidence interval for μ with confidence level Template:Math is

12χ2(α/2;2k)μ12χ2(1α/2;2k+2),

or equivalently,

F1(α/2;k,1)μF1(1α/2;k+1,1),

where χ2(p;n) is the quantile function (corresponding to a lower tail area p) of the chi-squared distribution with Template:Mvar degrees of freedom and F1(p;n,1) is the quantile function of a gamma distribution with shape parameter n and scale parameter 1.Template:R This interval is 'exact' in the sense that its coverage probability is never less than the nominal Template:Math.

When quantiles of the gamma distribution are not available, an accurate approximation to this exact interval has been proposed (based on the Wilson–Hilferty transformation):Template:R

k(119kzα/23k)3μ(k+1)(119(k+1)+zα/23k+1)3,

where zα/2 denotes the standard normal deviate with upper tail area Template:Math.

For application of these formulae in the same context as above (given a sample of Template:Mvar measured values Template:Mvari each drawn from a Poisson distribution with mean Template:Mvar), one would set

k=i=1nki,

calculate an interval for Template:Nobr and then derive the interval for Template:Mvar.

Bayesian inference

In Bayesian inference, the conjugate prior for the rate parameter Template:Mvar of the Poisson distribution is the gamma distribution.Template:R Let

λGamma(α,β)

denote that Template:Mvar is distributed according to the gamma density g parameterized in terms of a shape parameter α and an inverse scale parameter β:

g(λα,β)=βαΓ(α)λα1eβλ for λ>0.

Then, given the same sample of Template:Mvar measured values Template:Mvari as before, and a prior of Gamma(α, β), the posterior distribution is

λGamma(α+i=1nki,β+n).

Note that the posterior mean is linear and is given by

E[λk1,,kn]=α+i=1nkiβ+n.

It can be shown that gamma distribution is the only prior that induces linearity of the conditional mean. Moreover, a converse result exists which states that if the conditional mean is close to a linear function in the L2 distance than the prior distribution of Template:Mvar must be close to gamma distribution in Levy distance.[17]

The posterior mean E[[[:Template:Mvar]]] approaches the maximum likelihood estimate λ^MLE in the limit as α0,β0, which follows immediately from the general expression of the mean of the gamma distribution.

The posterior predictive distribution for a single additional observation is a negative binomial distribution,Template:R sometimes called a gamma–Poisson distribution.

Simultaneous estimation of multiple Poisson means

Suppose X1,X2,,Xp is a set of independent random variables from a set of p Poisson distributions, each with a parameter λi, i=1,,p, and we would like to estimate these parameters. Then, Clevenson and Zidek show that under the normalized squared error loss L(λ,λ^)=i=1pλi1(λ^iλi)2, when p>1, then, similar as in Stein's example for the Normal means, the MLE estimator λ^i=Xi is inadmissible. Template:R

In this case, a family of minimax estimators is given for any 0<c2(p1) and b(p2+p1) asTemplate:R

λ^i=(1cb+i=1pXi)Xi,i=1,,p.

Occurrence and applications

Template:More citations needed

Some applications of the Poisson distribution to count data (number of events):Template:R

More examples of counting events that may be modelled as Poisson processes include:

In probabilistic number theory, Gallagher showed in 1976 that, if a certain version of the unproved prime r-tuple conjecture holds,Template:R then the counts of prime numbers in short intervals would obey a Poisson distribution.Template:R

Template:Anchor

Law of rare events

Template:Main

Comparison of the Poisson distribution (black lines) and the binomial distribution with Template:Nobr (red circles), Template:Nobr (blue circles), Template:Nobr (green circles). All distributions have a mean of 5. The horizontal axis shows the number of events Template:Mvar. As Template:Mvar gets larger, the Poisson distribution becomes an increasingly better approximation for the binomial distribution with the same mean.

The rate of an event is related to the probability of an event occurring in some small subinterval (of time, space or otherwise). In the case of the Poisson distribution, one assumes that there exists a small enough subinterval for which the probability of an event occurring twice is "negligible". With this assumption one can derive the Poisson distribution from the binomial one, given only the information of expected number of total events in the whole interval.

Let the total number of events in the whole interval be denoted by λ. Divide the whole interval into n subintervals I1,,In of equal size, such that n>λ (since we are interested in only very small portions of the interval this assumption is meaningful). This means that the expected number of events in each of the Template:Mvar subintervals is equal to λ/n.

Now we assume that the occurrence of an event in the whole interval can be seen as a sequence of Template:Mvar Bernoulli trials, where the i-th Bernoulli trial corresponds to looking whether an event happens at the subinterval Ii with probability λ/n. The expected number of total events in n such trials would be λ, the expected number of total events in the whole interval. Hence for each subdivision of the interval we have approximated the occurrence of the event as a Bernoulli process of the form B(n,λ/n). As we have noted before we want to consider only very small subintervals. Therefore, we take the limit as n goes to infinity.

In this case the binomial distribution converges to what is known as the Poisson distribution by the Poisson limit theorem.

In several of the above examples — such as, the number of mutations in a given sequence of DNA—the events being counted are actually the outcomes of discrete trials, and would more precisely be modelled using the binomial distribution, that is XB(n,p).

In such cases Template:Mvar is very large and Template:Mvar is very small (and so the expectation Template:Mvar is of intermediate magnitude). Then the distribution may be approximated by the less cumbersome Poisson distribution XPois(np).

This approximation is sometimes known as the law of rare events,Template:R since each of the Template:Mvar individual Bernoulli events rarely occurs.

The name "law of rare events" may be misleading because the total count of success events in a Poisson process need not be rare if the parameter Template:Mvar is not small. For example, the number of telephone calls to a busy switchboard in one hour follows a Poisson distribution with the events appearing frequent to the operator, but they are rare from the point of view of the average member of the population who is very unlikely to make a call to that switchboard in that hour.

The variance of the binomial distribution is 1 − p times that of the Poisson distribution, so almost equal when p is very small.

The word law is sometimes used as a synonym of probability distribution, and convergence in law means convergence in distribution. Accordingly, the Poisson distribution is sometimes called the "law of small numbers" because it is the probability distribution of the number of occurrences of an event that happens rarely but has very many opportunities to happen. The Law of Small Numbers is a book by Ladislaus Bortkiewicz about the Poisson distribution, published in 1898.Template:RTemplate:R

Poisson point process

Template:Main

The Poisson distribution arises as the number of points of a Poisson point process located in some finite region. More specifically, if D is some region space, for example Euclidean space Rd, for which |D|, the area, volume or, more generally, the Lebesgue measure of the region is finite, and if Template:Nobr denotes the number of points in D, then

P(N(D)=k)=(λ|D|)keλ|D|k!.

Poisson regression and negative binomial regression

Poisson regression and negative binomial regression are useful for analyses where the dependent (response) variable is the count Template:Nobr of the number of events or occurrences in an interval.

Biology

The Luria–Delbrück experiment tested against the hypothesis of Lamarckian evolution, which should result in a Poisson distribution.

Katz and Miledi measured the membrane potential with and without the presence of acetylcholine (ACh).[18] When ACh is present, ion channels on the membrane would be open randomly at a small fraction of the time. As there are a large number of ion channels each open for a small fraction of the time, the total number of ion channels open at any moment is Poisson distributed. When ACh is not present, effectively no ion channels are open. The membrane potential is V=NopenVion+V0+Vnoise. Subtracting the effect of noise, Katz and Miledi found the mean and variance of membrane potential to be 8.5×103V,(29.2×106V)2, giving Vion=107V. (pp. 94-95 [19])

During each cellular replication event, the number of mutations is roughly Poisson distributed.[20] For example, the HIV virus has 10,000 base pairs, and has a mutation rate of about 1 per 30,000 base pairs, meaning the number of mutations per replication event is distributed as Pois(1/3). (p. 64 [19])

Other applications in science

In a Poisson process, the number of observed occurrences fluctuates about its mean Template:Mvar with a standard deviation σk=λ. These fluctuations are denoted as Poisson noise or (particularly in electronics) as shot noise.

The correlation of the mean and standard deviation in counting independent discrete occurrences is useful scientifically. By monitoring how the fluctuations vary with the mean signal, one can estimate the contribution of a single occurrence, even if that contribution is too small to be detected directly. For example, the charge e on an electron can be estimated by correlating the magnitude of an electric current with its shot noise. If N electrons pass a point in a given time t on the average, the mean current is I=eN/t; since the current fluctuations should be of the order σI=eN/t (i.e., the standard deviation of the Poisson process), the charge e can be estimated from the ratio tσI2/I.Template:Citation needed

An everyday example is the graininess that appears as photographs are enlarged; the graininess is due to Poisson fluctuations in the number of reduced silver grains, not to the individual grains themselves. By correlating the graininess with the degree of enlargement, one can estimate the contribution of an individual grain (which is otherwise too small to be seen unaided).Template:Cn

In causal set theory the discrete elements of spacetime follow a Poisson distribution in the volume.

The Poisson distribution also appears in quantum mechanics, especially quantum optics. Namely, for a quantum harmonic oscillator system in a coherent state, the probability of measuring a particular energy level has a Poisson distribution.

Computational methods

The Poisson distribution poses two different tasks for dedicated software libraries: evaluating the distribution P(k;λ), and drawing random numbers according to that distribution.

Evaluating the Poisson distribution

Computing P(k;λ) for given k and λ is a trivial task that can be accomplished by using the standard definition of P(k;λ) in terms of exponential, power, and factorial functions. However, the conventional definition of the Poisson distribution contains two terms that can easily overflow on computers: Template:MvarTemplate:Mvar and Template:Math. The fraction of Template:MvarTemplate:Mvar to Template:Mvar! can also produce a rounding error that is very large compared to eTemplate:Mvar, and therefore give an erroneous result. For numerical stability the Poisson probability mass function should therefore be evaluated as

f(k;λ)=exp[klnλλlnΓ(k+1)],

which is mathematically equivalent but numerically stable. The natural logarithm of the Gamma function can be obtained using the lgamma function in the C standard library (C99 version) or R, the gammaln function in MATLAB or SciPy, or the log_gamma function in Fortran 2008 and later.

Some computing languages provide built-in functions to evaluate the Poisson distribution, namely

  • R: function dpois(x, lambda);
  • Excel: function POISSON( x, mean, cumulative), with a flag to specify the cumulative distribution;
  • Mathematica: univariate Poisson distribution as PoissonDistribution[λ],[21] bivariate Poisson distribution as MultivariatePoissonDistribution[θ12,{ θ1θ12, θ2θ12}],.[22]

Random variate generation

Template:Further

The less trivial task is to draw integer random variate from the Poisson distribution with given λ.

Solutions are provided by:

A simple algorithm to generate random Poisson-distributed numbers (pseudo-random number sampling) has been given by Knuth:Template:R

algorithm poisson random number (Knuth):
    init:
        Let L ← e−λ, k ← 0 and p ← 1.
    do:
        k ← k + 1.
        Generate uniform random number u in [0,1] and let p ← p × u.
    while p > L.
    return k − 1.

The complexity is linear in the returned value Template:Mvar, which is Template:Mvar on average. There are many other algorithms to improve this. Some are given in Ahrens & Dieter, see Template:Slink below.

For large values of Template:Mvar, the value of Template:Mvar = eTemplate:Mvar may be so small that it is hard to represent. This can be solved by a change to the algorithm which uses an additional parameter STEP such that e−STEP does not underflow: Template:Citation needed

algorithm poisson random number (Junhao, based on Knuth):
    init:
        Let Template:MvarLeft ← Template:Mvar, k ← 0 and p ← 1.
    do:
        k ← k + 1.
        Generate uniform random number u in (0,1) and let p ← p × u.
        while p < 1 and Template:MvarLeft > 0:
            if Template:MvarLeft > STEP:
                p ← p × eSTEP
                Template:MvarLeft ← Template:MvarLeft − STEP
            else:
                p ← p × eTemplate:MvarLeft
                Template:MvarLeft ← 0
    while p > 1.
    return k − 1.

The choice of STEP depends on the threshold of overflow. For double precision floating point format the threshold is near e700, so 500 should be a safe STEP.

Other solutions for large values of Template:Mvar include rejection sampling and using Gaussian approximation.

Inverse transform sampling is simple and efficient for small values of Template:Mvar, and requires only one uniform random number u per sample. Cumulative probabilities are examined in turn until one exceeds u.

algorithm Poisson generator based upon the inversion by sequential search:Template:R
    init:
        Let x ← 0, p ← e−λ, s ← p.
        Generate uniform random number u in [0,1].
    while u > s do:
        x ← x + 1.
        p ← p × Template:Mvar / x.
        s ← s + p.
    return x.

See also

Template:Div col

Template:Div col end

References

Citations

Template:Reflist

Sources

Template:Refbegin

Template:Refend

Template:Clear Template:ProbDistributions

Template:Authority control

  1. Template:Cite book
  2. For the proof, see: Proof wiki: expectation and Proof wiki: variance
  3. Template:Cite book
  4. Template:Cite book
  5. Template:Cite journal
  6. Template:Cite journal
  7. Template:Cite book
  8. Template:Cite journal
  9. Template:Cite journal
  10. Template:Cite book
  11. Template:Cite web
  12. Free Random Variables by D. Voiculescu, K. Dykema, A. Nica, CRM Monograph Series, American Mathematical Society, Providence RI, 1992
  13. Alexandru Nica, Roland Speicher: Lectures on the Combinatorics of Free Probability. London Mathematical Society Lecture Note Series, Vol. 335, Cambridge University Press, 2006.
  14. Lectures on the Combinatorics of Free Probability by A. Nica and R. Speicher, pp. 203–204, Cambridge Univ. Press 2006
  15. Template:Cite web
  16. Template:Cite book
  17. Template:Cite journal
  18. Template:Cite journal
  19. 19.0 19.1 Template:Cite book
  20. Template:Citation
  21. Template:Cite web
  22. Template:Cite web