Cantelli's inequality

From testwiki
Jump to navigation Jump to search

In probability theory, Cantelli's inequality (also called the Chebyshev-Cantelli inequality and the one-sided Chebyshev inequality) is an improved version of Chebyshev's inequality for one-sided tail bounds.[1][2][3] The inequality states that, for λ>0,

Pr(X𝔼[X]λ)σ2σ2+λ2,

where

X is a real-valued random variable,
Pr is the probability measure,
𝔼[X] is the expected value of X,
σ2 is the variance of X.

Applying the Cantelli inequality to X gives a bound on the lower tail,

Pr(X𝔼[X]λ)σ2σ2+λ2.

While the inequality is often attributed to Francesco Paolo Cantelli who published it in 1928,[4] it originates in Chebyshev's work of 1874.[5] When bounding the event random variable deviates from its mean in only one direction (positive or negative), Cantelli's inequality gives an improvement over Chebyshev's inequality. The Chebyshev inequality has "higher moments versions" and "vector versions", and so does the Cantelli inequality.

Comparison to Chebyshev's inequality

For one-sided tail bounds, Cantelli's inequality is better, since Chebyshev's inequality can only get

Pr(X𝔼[X]λ)Pr(|X𝔼[X]|λ)σ2λ2.

On the other hand, for two-sided tail bounds, Cantelli's inequality gives

Pr(|X𝔼[X]|λ)=Pr(X𝔼[X]λ)+Pr(X𝔼[X]λ)2σ2σ2+λ2,

which is always worse than Chebyshev's inequality (when λσ; otherwise, both inequalities bound a probability by a value greater than one, and so are trivial).

Generalizations

Various stronger inequalities can be shown. He, Zhang, and Zhang showed[6] (Corollary 2.3) when 𝔼[X]=0,𝔼[X2]=1 and λ0:

Pr(Xλ)1(233)(1+λ2)2𝔼[X4]+6λ2+λ4.

In the case λ=0 this matches a bound in Berger's "The Fourth Moment Method",[7]

Pr(X0)233𝔼[X4].

This improves over Cantelli's inequality in that we can get a non-zero lower bound, even when 𝔼[X]=0.

See also

References

Template:Reflist