Ratio distribution

From testwiki
Jump to navigation Jump to search

Template:Short description A ratio distribution (also known as a quotient distribution) is a probability distribution constructed as the distribution of the ratio of random variables having two other known distributions. Given two (usually independent) random variables Template:Mvar and Template:Mvar, the distribution of the random variable Template:Mvar that is formed as the ratio Template:Math is a ratio distribution.

An example is the Cauchy distribution (also called the normal ratio distribution), which comes about as the ratio of two normally distributed variables with zero mean. Two other distributions often used in test-statistics are also ratio distributions: the Template:Student's t-distribution arises from a Gaussian random variable divided by an independent chi-distributed random variable, while the F-distribution originates from the ratio of two independent chi-squared distributed random variables. More general ratio distributions have been considered in the literature.Template:SfnpTemplate:SfnpTemplate:SfnpTemplate:SfnpTemplate:SfnpTemplate:Sfnp[1]

Often the ratio distributions are heavy-tailed, and it may be difficult to work with such distributions and develop an associated statistical test. A method based on the median has been suggested as a "work-around".Template:Sfnp

Algebra of random variables

Template:Main The ratio is one type of algebra for random variables: Related to the ratio distribution are the product distribution, sum distribution and difference distribution. More generally, one may talk of combinations of sums, differences, products and ratios. Many of these distributions are described in Melvin D. Springer's book from 1979 The Algebra of Random Variables.Template:Sfnp

The algebraic rules known with ordinary numbers do not apply for the algebra of random variables. For example, if a product is Template:Tmath and a ratio is Template:Tmath it does not necessarily mean that the distributions of Template:Tmath and Template:Tmath are the same. Indeed, a peculiar effect is seen for the Cauchy distribution: The product and the ratio of two independent Cauchy distributions (with the same scale parameter and the location parameter set to zero) will give the same distribution.Template:Sfnp This becomes evident when regarding the Cauchy distribution as itself a ratio distribution of two Gaussian distributions of zero means: Consider two Cauchy random variables, Template:Tmath and Template:Tmath, each constructed from two Gaussian distributions Template:Tmath and Template:Tmath. Then C1C2=G1/G2G3/G4=G1G4G2G3=G1G2×G4G3=C1×C3, where Template:Tmath. The first term is the ratio of two Cauchy distributions while the last term is the product of two such distributions.

Derivation

A way of deriving the ratio distribution of Template:Tmath from the joint distribution of the two other random variables Template:Tmath, Template:Tmath, with joint Template:Abbr Template:Tmath, is by integration of the following formTemplate:Sfnp pZ(z)=∫−∞+∞|y|pX,Y(zy,y)dy.

If the two variables are independent then pXY(x,y)=pX(x)pY(y) and this becomes pZ(z)=∫−∞+∞|y|pX(zy)pY(y)dy.

This may not be straightforward. By way of example take the classical problem of the ratio of two standard Gaussian samples. The joint Template:Abbr is pX,Y(x,y)=12πexp⁡(−x22)exp⁡(−y22).

Defining Z=X/Y we have pZ(z)=12π∫−∞∞|y|exp⁡(−(zy)22)exp⁡(−y22)dy=12π∫−∞∞|y|exp⁡(−y2(z2+1)2)dy. Using the known definite integral ∫0∞xexp⁡(−cx2)dx=12c we get pZ(z)=1π(z2+1), which is the Cauchy distribution, or Template:Student's t-distribution with Template:Tmath.

The Mellin transform has also been suggested for derivation of ratio distributions.Template:Sfnp

In the case of positive independent variables, proceed as follows. The diagram shows a separable bivariate distribution fx,y(x,y)=fx(x)fy(y) which has support in the positive quadrant x,y>0 and we wish to find the pdf of the ratio Template:Tmath. The hatched volume above the line Template:Tmath represents the cumulative distribution of the function Template:Tmath multiplied with the logical function Template:Tmath. The density is first integrated in horizontal strips; the horizontal strip at height Template:Tmath extends from Template:Tmath to Template:Tmath and has incremental probability fy(y)dy∫0Ryfx(x)dx.

Secondly, integrating the horizontal strips upward over all Template:Tmath yields the volume of probability above the line FR(R)=∫0∞fy(y)(∫0Ryfx(x)dx)dy Finally, differentiate FR(R) with respect to R to get the Template:Abbr Template:Tmath. fR(R)=ddR[∫0∞fy(y)(∫0Ryfx(x)dx)dy] Move the differentiation inside the integral: fR(R)=∫0∞fy(y)(ddR∫0Ryfx(x)dx)dy and since ddR∫0Ryfx(x)dx=yfx(Ry) then fR(R)=∫0∞fy(y)fx(Ry)ydy. As an example, find the Template:Abbr of the ratio Template:Tmath when fx(x)=αe−αx,fy(y)=βe−βy,x,y≥0.

Evaluating the cumulative distribution of a ratio

We have ∫0Ryfx(x)dx=−e−αx|0Ry=1−e−αRy thus FR(R)=∫0∞fy(y)(1−e−αRy)dy=∫0∞βe−βy(1−e−αRy)dy=1−αRβ+αR=Rβα+R. Differentiation with respect to Template:Tmath yields the Template:Abbr of Template:Tmath: fR(R)=ddR(Rβα+R)=βα(βα+R)2.

Moments of random ratios

From Mellin transform theory, for distributions existing only on the positive half-line Template:Tmath, we have the product identity E⁡[(UV)p]=E⁡[Up]⋅E⁡[Vp] provided Template:Tmath, Template:Tmath are independent. For the case of a ratio of samples like Template:Tmath, in order to make use of this identity it is necessary to use moments of the inverse distribution. Set 1/Y=Z such that Template:Tmath. Thus, if the moments of Xp and Y−p can be determined separately, then the moments of X/Y can be found. The moments of Y−p are determined from the inverse Template:Abbr of Template:Tmath, often a tractable exercise. At simplest, Template:Tmath.

To illustrate, let X be sampled from a standard Gamma distribution xα−1e−x/Γ(α) whose Template:Tmath-th moment is Template:Tmath.

Z=Y−1 is sampled from an inverse Gamma distribution with parameter β and has Template:Abbr Template:Tmath. The moments of this PDF are E⁡[Zp]=E⁡[Y−p]=Γ(β−p)Γ(β),p<β.

Multiplying the corresponding moments gives E⁡[(X/Y)p]=E⁡[Xp]⋅E⁡[Y−p]=Γ(α+p)Γ(α)Γ(β−p)Γ(β),p<β.

Independently, it is known that the ratio of the two Gamma samples R=X/Y follows the beta prime distribution: fβ′(r,α,β)=B(α,β)−1rα−1(1+r)−(α+β) whose moments are E⁡[Rp]=B(α+p,β−p)B(α,β).

Substituting B(α,β)=Γ(α)Γ(β)Γ(α+β) we have E⁡[Rp]=Γ(α+p)Γ(β−p)Γ(α+β)/Γ(α)Γ(β)Γ(α+β)=Γ(α+p)Γ(β−p)Γ(α)Γ(β), which is consistent with the product of moments above.

Means and variances of random ratios

In the Product distribution section, and derived from Mellin transform theory (see section above), it is found that the mean of a product of independent variables is equal to the product of their means. In the case of ratios, we have E⁡(X/Y)=E⁡(X)⋅E⁡(1/Y) which, in terms of probability distributions, is equivalent to E⁡(X/Y)=∫−∞∞xfx(x)dx×∫−∞∞y−1fy(y)dy.

Note that Template:Tmath; i.e., Template:Tmath.

The variance of a ratio of independent variables is Var⁡(X/Y)=E⁡([X/Y]2)−E2⁡(X/Y)=E⁡(X2)⋅E⁡(1/Y2)−E2(X)⋅E2(1/Y).

Normal ratio distributionsTemplate:Anchor

Template:Split section

Uncorrelated central normal ratio

When Template:Tmath and Template:Tmath are independent and have a Gaussian distribution with zero mean, the form of their ratio distribution is a Cauchy distribution. This can be derived by setting Template:Tmath, then showing that Template:Tmath has circular symmetry. For a bivariate uncorrelated Gaussian distribution we have p(x,y)=12πexp⁡(−x22)×12πexp⁡(−y22)=12πexp⁡(−x2+y22)=12πexp⁡(−r22), for r2=x2+y2.

If Template:Tmath is a function only of Template:Tmath, then Template:Tmath is uniformly distributed on Template:Tmath with density Template:Tmath, so the problem reduces to finding the probability distribution of Template:Tmath under the mapping Z=X/Y=tan⁡θ.

We have, by conservation of probability pz(z)|dz|=pθ(θ)|dθ|, and since Template:Tmath, pz(z)=pθ(θ)|dzdθ|=12πcos2θ. Setting cos2θ=11+(tan⁡θ)2=11+z2, we get pz(z)=1/(2π)1+z2. There is a spurious factor of 2 here. Actually, two values of θ spaced by π map onto the same value of Template:Tmath, the density is doubled, and the final result is pz(z)=1/π1+z2,−∞<z<∞.

When either of the two normal distributions is non-central, then the result for the distribution of the ratio is much more complicated and is given below in the succinct form presented by David Hinkley.Template:Sfnp The trigonometric method for a ratio does, however, extend to radial distributions like bivariate normals or a bivariate Template:Student's t-distribution, in which the density depends only on radius Template:Tmath. It does not extend to the ratio of two independent Template:Student's t-distributions, which give the Cauchy ratio shown in a section below for one degree of freedom.

Uncorrelated noncentral normal ratio

In the absence of correlation (Template:Tmath), the probability density function of the ratio Template:Tmath of two normal variables X=𝒩(μX,σX2) and Y=𝒩(μY,σY2) is given exactly by the following expression, derived in several sources:Template:Sfnp pZ(z)=e−c/2a2(z)⋅2πσxσy(2πb(z)a(z)exp⁡(b2(z)2a2(z))erf(b(z)2a(z))+2), where a(z)=1σx2z2+1σy2,b(z)=μxσx2z+μyσy2,c=μx2σx2+μy2σy2.

Under several assumptions (usually fulfilled in practical applications), it is possible to derive a highly accurate solid approximation to the Template:Abbr. Main benefits include reduced formulae complexity, closed-form Template:Abbr, simple defined median, and well defined error management. For the sake of simplicity introduce parameters: Template:Tmath, Template:Tmath, and Template:Tmath. Then the so-called solid approximation pZ†(z) to the uncorrelated noncentral normal ratio PDF is expressed by equationTemplate:Sfnp pZ†(z)=1πperf[q]1r1+p2q2zr(1+p2q2[zr]2)32exp⁡(−p2(zr−1)21+p2q2[zr]2).

Under certain conditions, a normal approximation is possible, with variance:Template:Sfnp σz2=μx2μy2(σx2μx2+σy2μy2).

Correlated central normal ratio

The above expression becomes more complicated when the variables Template:Tmath and Template:Tmath are correlated. If Template:Tmath Template:Tmath but Template:Tmath and Template:Tmath, the more general Cauchy distribution is obtained, pZ(z)=1πβ(z−α)2+β2, where Template:Tmath is the correlation coefficient between Template:Tmath and Template:Tmath, and α=ρσxσy,β=σxσy1−ρ2.

The complex distribution has also been expressed with Kummer's confluent hypergeometric function or the Hermite function.Template:Sfnp

Correlated noncentral normal ratio

This was shown in Springer.Template:Sfnp.

A transformation to the log domain was suggested by KatzTemplate:Sfnp Template:See below. Let the ratio be T∼μx+𝒩(0,σx2)μy+𝒩(0,σy2)=μx+Xμy+Y=μxμy1+Xμx1+Yμy.

Take the logarithm of both sides to get ln⁡(T)=ln⁡(μxμy)+ln⁡(1+Xμx)−ln⁡(1+Yμy). Observing that Template:Tmath, then asymptotically ln⁡(T)≈ln⁡(μxμy)+Xμx−Yμy∼ln⁡(μxμy)+𝒩(0,σx2μx2+σy2μy2−2Cov⁡(X,Y)μxμy).

Alternatively, Geary suggested in 1930 that t≈μyT−μxσy2T2−2ρσxσyT+σx2 has approximately a standard Gaussian distribution;Template:Sfnp This transformation has been called the Geary–Hinkley transformation.Template:Sfnp The approximation is good if Template:Tmath is unlikely to assume negative values, i.e., Template:Tmath.

Exact correlated noncentral normal ratio

Template:Original synthesis

This is developed by SpringerTemplate:Sfnp and Hinkley.Template:Sfnp Geary showed how the correlated ratio Template:Tmath could be transformed into a near-Gaussian form and developed an approximation for Template:Tmath dependent on the probability of negative denominator values Template:Tmath being vanishingly small. Fieller's later correlated ratio analysis is exact but care is needed when combining modern math packages with verbal conditions in the older literature.Template:Cn Pham-Ghia has exhaustively discussed these methods.Template:Cn Hinkley's correlated results are exact but it is shown below that the correlated ratio condition can also be transformed into an uncorrelated one so only the simplified Hinkley equations above are required, not the full correlated ratio version.

Let the ratio be: z=x+μxy+μy in which Template:Tmath are zero-mean correlated normal variables with variances Template:Tmath and Template:Tmath have means Template:Tmath. Write x′=x−ρyσxσy such that Template:Tmath become uncorrelated and Template:Tmath has standard deviation Template:Tmath. Then the ratio z=x′+ρyσxσy+μxy+μy is invariant under this transformation and retains the same Template:Abbr.

The Template:Tmath term in the numerator appears to be made separable by expanding x′+ρyσxσy+μx=x′+μx−ρμyσxσy+ρ(y+μy)σxσy to get z=x′+μx′y+μy+ρσxσy in which μ'x=μx−ρμyσxσy and Template:Tmath has now become a ratio of uncorrelated non-central normal samples with an invariant Template:Tmath-offset.Template:Efn.

Finally, to be explicit, the PDF of the ratio Template:Tmath for correlated variables is found by inputting the modified parameters Template:Tmath, Template:Tmath and Template:Tmath into the Hinkley equation above which returns the PDF for the correlated ratio with a constant offset Template:Tmath on Template:Tmath.

Template:Multiple image

The figures above show an example of a positively correlated ratio with Template:Tmath Template:Tmath, Template:Tmath, Template:Tmath, and Template:Tmath, in which the shaded wedges represent the increment of area selected by given ratio Template:Tmath which accumulates probability where they overlap the distribution. The theoretical distribution, derived from the equations under discussion combined with Hinkley's equations, is highly consistent with a simulation result using 5,000 samples. In the top figure it is clear that for a ratio Template:Tmath the wedge has almost bypassed the main distribution mass altogether and this explains the local minimum in the theoretical PDF Template:Tmath. Conversely as Template:Tmath moves either toward or away from one the wedge spans more of the central mass, accumulating a higher probability.

Complex normal ratio

The ratio of correlated zero-mean circularly symmetric complex normal distributed variables was determined by Baxley et al.Template:Sfnp and has since been extended to the nonzero-mean and nonsymmetric case.Template:Sfnp In the correlated zero-mean case, the joint distribution of Template:Tmath is fx,y(x,y)=1π2|Σ|exp⁡(−[xy]HΣ−1[xy]) where Σ=[σx2ρσxσyρ∗σxσyσy2];x=xr+ixi;y=yr+iyi; (⋅)H is an Hermitian transpose; and ρ=ρr+iρi=E⁡(xy∗σxσy)∈|ℂ|≤1.

The Template:Abbr of Template:Tmath is found to be

fz(zr,zi)=1−|ρ|2πσx2σy2(|z|2σx2+1σy2−2ρrzr−ρiziσxσy)−2=1−|ρ|2πσx2σy2(|zσx−ρ∗σy|2+1−|ρ|2σy2)−2. In the usual event that σx=σy we get fz(zr,zi)=1−|ρ|2π(|z−ρ∗|2+1−|ρ|2)2.

Further closed-form results for the Template:Abbr are also given.

The ratio distribution of correlated complex variables, Template:Math.

The graph shows the pdf of the ratio of two complex normal variables with a correlation coefficient of Template:Tmath. The PDF peak occurs at roughly the complex conjugate of a scaled down Template:Tmath.

Ratio of log-normal

The ratio of independent or correlated log-normals is log-normal. This follows, because if X1 and X2 are log-normally distributed, then ln⁡(X1) and ln⁡(X2) are normally distributed. If they are independent or their logarithms follow a bivarate normal distribution, then the logarithm of their ratio is the difference of independent or correlated normally distributed random variables, which is normally distributed.Template:Efn

This is important for many applications requiring the ratio of random variables that must be positive, where joint distribution of X1 and X2 is adequately approximated by a log-normal. This is a common result of the multiplicative central limit theorem, also known as Gibrat's law, when Xi is the result of an accumulation of many small percentage changes and must be positive and approximately log-normally distributed.Template:Efn

Uniform ratio distribution

With two independent random variables following a uniform distribution, e.g., pX(x)={1,0<x<10,otherwise the ratio distribution becomes pZ(z)={12,0<z<112z2,z≥10,otherwise.

Cauchy ratio distribution

If two independent random variables, Template:Tmath and Template:Tmath each follow a Cauchy distribution with median equal to zero and shape factor Template:Tmath, pX(x|a)=aπ(a2+x2), then the ratio distribution for the random variable Template:Tmath isTemplate:Sfnp pZ(z|a)=1π2(z2−1)ln⁡(z2). This distribution does not depend on Template:Tmath and the result stated by SpringerTemplate:Sfnp is not correct.

The ratio distribution is similar to but not the same as the product distribution of the random variable Template:Tmath:Template:Sfnp pW(w|a)=a2π2(w2−a4)ln⁡(w2a4).

More generally, if two independent random variables Template:Tmath and Template:Tmath each follow a Cauchy distribution with median equal to zero and shape factor Template:Tmath and Template:Tmath respectively, then:

  1. The ratio distribution for the random variable Template:Tmath isTemplate:Sfnp pZ(z|a,b)=abπ2(b2z2−a2)ln⁡(b2z2a2).
  2. The product distribution for the random variable Template:Tmath isTemplate:Sfnp pW(w|a,b)=abπ2(w2−a2b2)ln⁡(w2a2b2).

The result for the ratio distribution can be obtained from the product distribution by replacing Template:Tmath with Template:Tmath.

Ratio of standard normal to standard uniform

Template:Main If Template:Tmath has a standard normal distribution and Template:Tmath has a standard uniform distribution, then Template:Tmath has a distribution known as the slash distribution, with probability density function pZ(z)={[φ(0)−φ(z)]z2,z≠0φ(0)2,z=0, where Template:Tmath is the probability density function of the standard normal distribution.[2]

Chi-squared, Gamma distributions

Let Template:Tmath be a normal distribution Template:Tmath, Template:Tmath and Template:Tmath be chi-squared distributions with Template:Tmath and Template:Tmath degrees of freedom respectively, all independent, with fχ(x,k)=x(k2−1)e−x22k/2Γ(k2). Then

If Template:Tmath, a noncentral chi-squared distribution, Template:Tmath, and Template:Tmath is independent of Template:Tmath, then V1/k1V2/k2∼F'k1,k2(λ), a [[noncentral F-distribution|noncentral Template:ItcoF-distribution]].

mnF'm,n=β′(m2,n2) or F'm,n=β′(m2,n2,1,nm) defines Template:Tmath, Fisher's Template:Itco density distribution, the Template:Abbr of the ratio of two chi-squared distributions with Template:Tmath degrees of freedom.Template:Efn

If we enter an Template:Itco-test table with Template:Tmath, Template:Tmath and 5% probability in the right tail, the critical value is found to be 6.59. This coincides with the integral F3,4(6.59)=∫6.59∞β′(x;m2,n2,1,nm)dx=0.05.

For gamma distributions Template:Tmath and Template:Tmath with arbitrary shape parameters Template:Tmath and Template:Tmath, and their scale parameters both set to unity (that is, Template:Tmath, Template:Tmath, where Template:Tmath), then

UU+V∼β(α1,α2), expectation =α1α1+α2;UV∼β′(α1,α2), expectation =α1α2−1,α2>1;VU∼β′(α2,α1), expectation =α2α1−1,α1>1.

If Template:Tmath, then θU∼Γ(x;α,θ)=xα−1e−x/θθkΓ(α). Note that here Template:Tmath is a scale parameter, rather than a rate parameter.

If Template:Tmath, Template:Tmath, then by rescaling the Template:Tmath parameter to unity we have Uθ1Uθ1+Vθ2=θ2Uθ2U+θ1V∼β(α1,α2)Uθ1Vθ2=θ2θ1UV∼β′(α1,α2). Thus UV∼β′(α1,α2,1,θ1θ2)E⁡[UV]=θ1θ2α1α2−1, in which β′(α,β,p,q) represents the generalised beta prime distribution.

In the foregoing it is apparent that if X∼β′(α1,α2,1,1)≡β′(α1,α2) then θX∼β′(α1,α2,1,θ). More explicitly, since β′(x;α1,α2,1,R)=1Rβ′(xR;α1,α2) if U∼Γ(α1,θ1),V∼Γ(α2,θ2) then UV∼1Rβ′(xR;α1,α2)=(xR)α1−1(1+xR)α1+α2⋅1RB(α1,α2), where x≥0;R=θ1θ2;B(α1,α2)=Γ(α1)Γ(α2)Γ(α1+α2).

Beta distributions

First developed by T. Pham-GiaTemplate:Sfnp who found that the PDF of a Beta ratio can be expressed in terms of hypergeometric functions. These are calculated numerically as an infinite discrete sum or as an integral. The latter is straightforward such that, if Y is the ratio of two independent Beta samples Y=X1/X2, each with PDF B(α,β)−1xα−1(1−x)β−1 proceeds in two ranges 0≤y<1 and 1<y<∞ thus

fA(y|0<y≤1)=1B(α1,β1)(α2,β2)yα1−1∫01dppα1+α2−1(1−p)β2−1(1−py)β1−1fB(y|1<y<∞)=1B(α1,β1)(α2,β2)1yα2+1∫01dppα1+α2−1(1−p)β1−1(1−yp)β2−1

Rayleigh Distributions

If X, Y are independent samples from the Rayleigh distribution fr(r)=(r/σ2)e−r2/2σ2,r≥0, the ratio Z = X/Y follows the distributionTemplate:Sfnp

fz(z)=2z(1+z2)2,z≥0 and has cdf Fz(z)=1−11+z2=z21+z2,z≥0 The Rayleigh distribution has scaling as its only parameter. The distribution of Z=αX/Y follows fz(z,α)=2αz(α+z2)2,z>0 and has cdf Fz(z,α)=z2α+z2,z≥0


Fractional gamma distributions (including chi, chi-squared, exponential, Rayleigh and Weibull)

The generalized gamma distribution is f(x;a,d,r)=rΓ(d/r)adxd−1e−(x/a)rx≥0;a,d,r>0 which includes the regular gamma, chi, chi-squared, exponential, Rayleigh, Nakagami and Weibull distributions involving fractional powers. Note that here a is a scale parameter, rather than a rate parameter; d is a shape parameter.

Template:Block indent

Modelling a mixture of different scaling factors

In the ratios above, Gamma samples, U, V may have differing sample sizes α1,α2 but must be drawn from the same distribution xα−1e−x/θθkΓ(α) with equal scaling θ.

In situations where U and V are differently scaled, a variables transformation allows the modified random ratio pdf to be determined. Let X=UU+V=11+B where U∼Γ(α1,θ),V∼Γ(α2,θ),θ arbitrary and, from above, X∼Beta(α1,α2),B=V/U∼Beta′(α2,α1).

Rescale V arbitrarily, defining Y∼UU+φV=11+φB,0≤φ≤∞

We have B=1−XX and substitution into Y gives Y=Xφ+(1−φ)X, dY/dX=φ(φ+(1−φ)X)2

Transforming X to Y gives fY(Y)=fX(X)|dY/dX|=β(X,α1,α2)φ/[φ+(1−φ)X]2

Noting X=φY1−(1−φ)Y we finally have fY(Y,φ)=φ[1−(1−φ)Y]2β(φY1−(1−φ)Y,α1,α2),0≤Y≤1

Thus, if U∼Γ(α1,θ1) and V∼Γ(α2,θ2)
then Y=UU+V is distributed as fY(Y,φ) with φ=θ2θ1

The distribution of Y is limited here to the interval [0,1]. It can be generalized by scaling such that if Y∼fY(Y,φ) then

ΘY∼fY(Y,φ,Θ)

where fY(Y,φ,Θ)=φ/Θ[1−(1−φ)Y/Θ]2β(φY/Θ1−(1−φ)Y/Θ,α1,α2),0≤Y≤Θ Template:Block indent

Reciprocals of samples from beta distributions

Though not ratio distributions of two variables, the following identities for one variable are useful:

  • If X∼β(α,β) then 𝐱=X1−X∼β′(α,β)
  • If 𝐘∼β′(α,β) then y=1𝐘∼β′(β,α) combining the latter two equations yields
  • If X∼β(α,β) then 𝐱=1X−1∼β′(β,α).
  • If 𝐘∼β′(α,β) then y=𝐘1+𝐘∼β(α,β)

Corollary

11+𝐘=𝐘−1𝐘−1+1∼β(β,α)

Template:Block indent If U∼Γ(α,1),V∼Γ(β,1) then UV∼β′(α,β) and U/V1+U/V=UV+U∼β(α,β)

Further results can be found in the Inverse distribution article.

Binomial distribution

This result was derived by Katz et al.Template:Sfnp

Suppose X∼Binomial⁡(n,p1) and Y∼Binomial(m,p2) and Template:Tmath, Y are independent. Let Template:Tmath.

Then log⁡(T) is approximately normally distributed with mean log⁡(p1/p2) and variance Template:Tmath.

The binomial ratio distribution is of significance in clinical trials: if the distribution of T is known as above, the probability of a given ratio arising purely by chance can be estimated, i.e. a false positive trial. A number of papers compare the robustness of different approximations for the binomial ratio.Template:Citation needed

Poisson and truncated Poisson distributions

In the ratio of Poisson variables Template:Math there is a problem that Template:Mvar is zero with finite probability so Template:Mvar is undefined. To counter this, consider the truncated, or censored, ratio Template:Math where zero sample of Template:Mvar are discounted. Moreover, in many medical-type surveys, there are systematic problems with the reliability of the zero samples of both Template:Mvar and Template:Mvar and it may be good practice to ignore the zero samples anyway.

The probability of a null Poisson sample being Template:Tmath, the generic Template:Abbr of a left truncated Poisson distribution is p~x(x;λ)=11−e−λe−λλxx!,x∈1,2,3,⋯ which sums to unity. Following Cohen,Template:Sfnp for Template:Mvar independent trials, the multidimensional truncated Template:Abbr is p~(x1,x2,…,xn;λ)=1(1−e−λ)n∏i=1ne−λλxixi!,xi∈1,2,3,⋯ and the log-likelihood becomes L=ln⁡(p~)=−nln⁡(1−e−λ)−nλ+ln⁡(λ)∑i=1nxi−ln⁡∏i=1n(xi!),xi∈1,2,3,⋯ On differentiation we get dLdλ=−n1−e−λ+1λ∑i=1nxi and setting to zero gives the maximum likelihood estimate λ̂ML λ̂ML1−e−λ̂ML=1n∑i=1nxi=x¯

Note that as λ̂→0 then x¯→1 so the truncated maximum likelihood λ estimate, though correct for both truncated and untruncated distributions, gives a truncated mean x¯ value which is highly biassed relative to the untruncated one. Nevertheless it appears that x¯ is a sufficient statistic for λ since λ̂ML depends on the data only through the sample mean x¯=1n∑i=1nxi in the previous equation which is consistent with the methodology of the conventional Poisson distribution.

Absent any closed form solutions, the following approximate reversion for truncated λ is valid over the whole range Template:Tmath. λ̂=x¯−e−(x¯−1)−0.07(x¯−1)e−0.666(x¯−1)+ε,|ε|<0.006 which compares with the non-truncated version which is simply λ̂=x¯. Taking the ratio R=λ̂X/λ̂Y is a valid operation even though λ̂X may use a non-truncated model while λ̂Y has a left-truncated one.

The asymptotic large-nλ variance of λ̂ (and Cramér–Rao bound) is 𝕍𝕒𝕣(λ̂)≥−(𝔼[δ2Lδλ2]λ=λ̂)−1

in which substituting Template:Mvar gives δ2Lδλ2=−n[x¯λ2−e−λ(1−e−λ)2] Then substituting x¯ from the equation above, we get Cohen's variance estimate 𝕍𝕒𝕣(λ̂)≥λ̂n(1−e−λ̂)21−(λ̂+1)e−λ̂

The variance of the point estimate of the mean Template:Tmath, on the basis of Template:Mvar trials, decreases asymptotically to zero as Template:Mvar increases to infinity. For small λ it diverges from the truncated pdf variance in SpringaelTemplate:Sfnp for example, who quotes a variance of 𝕍𝕒𝕣(λ)=λ/n1−e−λ[1−λe−λ1−e−λ] for n samples in the left-truncated pdf shown at the top of this section. Cohen showed that the variance of the estimate relative to the variance of the pdf, 𝕍𝕒𝕣(λ̂)/𝕍𝕒𝕣(λ), ranges from 1 for large λ (100% efficient) up to 2 as λ approaches zero (50% efficient).

These mean and variance parameter estimates, together with parallel estimates for X, can be applied to Normal or Binomial approximations for the Poisson ratio. Samples from trials may not be a good fit for the Poisson process; a further discussion of Poisson truncation is by Dietz and BohningTemplate:Sfnp and there is a Zero-truncated Poisson distribution Wikipedia entry.

Double Lomax distribution

This distribution is the ratio of two Laplace distributions.Template:Sfnp Let X and Y be standard Laplace identically distributed random variables and let z = X / Y. Then the probability distribution of z is

f(x)=12(1+|z|)2

Let the mean of the X and Y be a. Then the standard double Lomax distribution is symmetric around a.

This distribution has an infinite mean and variance.

If Z has a standard double Lomax distribution, then 1/Z also has a standard double Lomax distribution.

The standard Lomax distribution is unimodal and has heavier tails than the Laplace distribution.

For 0 < a < 1, the a-th moment exists.

Λ=|𝐗||𝐗+𝐘|E(Za)=Γ(1+a)Γ(1−a)

where Template:Math is the gamma function.

Ratio distributions in multivariate analysis

Ratio distributions also appear in multivariate analysis.Template:Sfnp If the random matrices Template:Math and Template:Math follow a Wishart distribution then the ratio of the determinants φ=|𝐗||𝐘| is proportional to the product of independent F random variables. In the case where Template:Math and Template:Math are from independent standardized Wishart distributions then the ratio Λ=|𝐗||𝐗+𝐘| has a Wilks' lambda distribution.

Ratios of quadratic forms involving Wishart matrices

In relation to Wishart matrix distributions, if S∼Wp(Σ,ν+1) is a sample Wishart matrix, and vector V is arbitrary, but statistically independent, then corollary 3.2.9 of MuirheadTemplate:Sfnp states VTSVVTΣV∼χν2.

The discrepancy of one in the sample numbers arises from estimation of the sample mean when forming the sample covariance, a consequence of Cochran's theorem. Similarly, VTΣ−1VVTS−1V∼χν−p+12, which is Theorem 3.2.12 of Muirhead.Template:Sfnp

See also

Notes

Template:Notelist

References

Template:Reflist

Works cited

Template:Refbegin

Template:Refend