AM–GM inequality

From testwiki
Jump to navigation Jump to search

Template:Short description Template:AM GM inequality visual proof.svg

Visual proof that Template:Math. Taking square roots and dividing by two gives the AM–GM inequality.[1]

In mathematics, the inequality of arithmetic and geometric means, or more briefly the AM–GM inequality, states that the arithmetic mean of a list of non-negative real numbers is greater than or equal to the geometric mean of the same list; and further, that the two means are equal if and only if every number in the list is the same (in which case they are both that number).

The simplest non-trivial case is for two non-negative numbers Template:Mvar and Template:Mvar, that is,

x+y2xy

with equality if and only if Template:Math. This follows from the fact that the square of a real number is always non-negative (greater than or equal to zero) and from the identity Template:Math:

0(xy)2=x22xy+y2=x2+2xy+y24xy=(x+y)24xy.

Hence Template:Math, with equality when Template:Math, i.e. Template:Math. The AM–GM inequality then follows from taking the positive square root of both sides and then dividing both sides by 2.

For a geometrical interpretation, consider a rectangle with sides of length Template:Mvar and Template:Mvar; it has perimeter Template:Math and area Template:Mvar. Similarly, a square with all sides of length Template:Math has the perimeter Template:Math and the same area as the rectangle. The simplest non-trivial case of the AM–GM inequality implies for the perimeters that Template:Math and that only the square has the smallest perimeter amongst all rectangles of equal area.

The simplest case is implicit in Euclid's Elements, Book 5, Proposition 25.[2]

Extensions of the AM–GM inequality treat weighted means and generalized means.

Template:TOC limit

Background

The arithmetic mean, or less precisely the average, of a list of Template:Mvar numbers Template:Math is the sum of the numbers divided by Template:Mvar:

x1+x2++xnn.

The geometric mean is similar, except that it is only defined for a list of nonnegative real numbers, and uses multiplication and a root in place of addition and division:

x1x2xnn.

If Template:Math, this is equal to the exponential of the arithmetic mean of the natural logarithms of the numbers:

exp(lnx1+lnx2++lnxnn).

The inequality

Restating the inequality using mathematical notation, we have that for any list of Template:Mvar nonnegative real numbers Template:Math,

x1+x2++xnnx1x2xnn,

and that equality holds if and only if Template:Math.

Geometric interpretation

In two dimensions, Template:Math is the perimeter of a rectangle with sides of length Template:Math and Template:Math. Similarly, Template:Math is the perimeter of a square with the same area, Template:Math, as that rectangle. Thus for Template:Math the AM–GM inequality states that a rectangle of a given area has the smallest perimeter if that rectangle is also a square.

The full inequality is an extension of this idea to Template:Mvar dimensions. Consider an Template:Mvar-dimensional box with edge lengths Template:Math. Every vertex of the box is connected to Template:Mvar edges of different directions, so the average length of edges incident to the vertex is Template:Math. On the other hand, x1x2xnn is the edge length of an Template:Mvar-dimensional cube of equal volume, which therefore is also the average length of edges incident to a vertex of the cube.

Thus the AM–GM inequality states that only the [[Hypercube|Template:Mvar-cube]] has the smallest average length of edges connected to each vertex amongst all Template:Mvar-dimensional boxes with the same volume.[3]

Examples

Example 1

If a,b,c>0, then the AM-GM inequality tells us that

(1+a)(1+b)(1+c)21a21b21c=8abc

Example 2

A simple upper bound for n! can be found. AM-GM tells us

1+2++nnn!n
n(n+1)2nn!n

and so

(n+12)nn!

with equality at n=1.

Equivalently,

(n+1)n2nn!

Example 3

Consider the function

f(x,y,z)=xy+yz+zx3

for all positive real numbers Template:Mvar, Template:Mvar and Template:Mvar. Suppose we wish to find the minimal value of this function. It can be rewritten as:

f(x,y,z)=6xy+12yz+12yz+13zx3+13zx3+13zx36=6x1+x2+x3+x4+x5+x66

with

x1=xy,x2=x3=12yz,x4=x5=x6=13zx3.

Applying the AM–GM inequality for Template:Math, we get

f(x,y,z)6xy12yz12yz13zx313zx313zx36=6122333xyyzzx6=22/331/2.

Further, we know that the two sides are equal exactly when all the terms of the mean are equal:

f(x,y,z)=22/331/2whenxy=12yz=13zx3.

All the points Template:Math satisfying these conditions lie on a half-line starting at the origin and are given by

(x,y,z)=(t,233t,332t)witht>0.

Applications

Cauchy-Schwarz inequality

The AM-GM equality can be used to prove the Cauchy–Schwarz inequality.Template:Cn

Annualized returns

In financial mathematics, the AM-GM inequality shows that the annualized return, the geometric mean, is less than the average annual return, the arithmetic mean.

Nonnegative polynomials Template:Anchor

The Motzkin polynomial x4y2+x2y43x2y2+1 is a nonnegative polynomial which is not a sum of square polynomials. It can be proven nonnegative using the AM-GM inequality with x1=x4y2, x2=x2y4, and x3=1,[4] that is, (x4y2)(x2y4)(1)3(x4y2)+(x2y4)+(1)3. Simplifying and multiplying both sides by 3 gives 3x2y2x4y2+x2y4+1, so[5] 0x4y2+x2y43x2y2+1.

Proofs of the AM–GM inequality

The AM–GM inequality can be proven in many ways.

Proof using Jensen's inequality

Jensen's inequality states that the value of a concave function of an arithmetic mean is greater than or equal to the arithmetic mean of the function's values. Since the logarithm function is concave, we have

log(xin)1nlogxi=1nlog(xi)=log(xi)1/n.

Taking antilogs of the far left and far right sides, we have the AM–GM inequality.

Proof by successive replacement of elements

We have to show that

α=x1+x2++xnnx1x2xnn=β

with equality only when all numbers are equal.

If not all numbers are equal, then there exist xi,xj such that xi<α<xj. Replacing Template:Mvar by α and Template:Mvar by (xi+xjα) will leave the arithmetic mean of the numbers unchanged, but will increase the geometric mean because

α(xj+xiα)xixj=(αxi)(xjα)>0

If the numbers are still not equal, we continue replacing numbers as above. After at most (n1) such replacement steps all the numbers will have been replaced with α while the geometric mean strictly increases at each step. After the last step, the geometric mean will be αααn=α, proving the inequality.

It may be noted that the replacement strategy works just as well from the right hand side. If any of the numbers is 0 then so will the geometric mean thus proving the inequality trivially. Therefore we may suppose that all the numbers are positive. If they are not all equal, then there exist xi,xj such that 0<xi<β<xj. Replacing xi by β and xj by xixjβleaves the geometric mean unchanged but strictly decreases the arithmetic mean since

xi+xjβxixjβ=(βxi)(xjβ)β>0. The proof then follows along similar lines as in the earlier replacement.

Induction proofs

Proof by induction #1

Of the non-negative real numbers Template:Math, the AM–GM statement is equivalent to

αnx1x2xn

with equality if and only if Template:Math for all Template:Math.

For the following proof we apply mathematical induction and only well-known rules of arithmetic.

Induction basis: For Template:Math the statement is true with equality.

Induction hypothesis: Suppose that the AM–GM statement holds for all choices of Template:Mvar non-negative real numbers.

Induction step: Consider Template:Math non-negative real numbers Template:Math, . Their arithmetic mean Template:Mvar satisfies

(n+1)α= x1++xn+xn+1.

If all the Template:Mvar are equal to Template:Mvar, then we have equality in the AM–GM statement and we are done. In the case where some are not equal to Template:Mvar, there must exist one number that is greater than the arithmetic mean Template:Mvar, and one that is smaller than Template:Mvar. Without loss of generality, we can reorder our Template:Mvar in order to place these two particular elements at the end: Template:Math and Template:Math. Then

xnα>0αxn+1>0
(xnα)(αxn+1)>0.(*)

Now define Template:Math with

y:=xn+xn+1αxnα>0,

and consider the Template:Mvar numbers Template:Math which are all non-negative. Since

(n+1)α=x1++xn1+xn+xn+1
nα=x1++xn1+xn+xn+1α=y,

Thus, Template:Mvar is also the arithmetic mean of Template:Mvar numbers Template:Math and the induction hypothesis implies

αn+1=αnαx1x2xn1yα.(**)

Due to (*) we know that

(xn+xn+1α=y)αxnxn+1=(xnα)(αxn+1)>0,

hence

yα>xnxn+1,(***)

in particular Template:Math. Therefore, if at least one of the numbers Template:Math is zero, then we already have strict inequality in (**). Otherwise the right-hand side of (**) is positive and strict inequality is obtained by using the estimate (***) to get a lower bound of the right-hand side of (**). Thus, in both cases we can substitute (***) into (**) to get

αn+1>x1x2xn1xnxn+1,

which completes the proof.

Proof by induction #2

First of all we shall prove that for real numbers Template:Math and Template:Math there follows

x1+x2>x1x2+1.

Indeed, multiplying both sides of the inequality Template:Math by Template:Math, gives

x2x1x2>1x1,

whence the required inequality is obtained immediately.

Now, we are going to prove that for positive real numbers Template:Math satisfying Template:Math, there holds

x1++xnn.

The equality holds only if Template:Math.

Induction basis: For Template:Math the statement is true because of the above property.

Induction hypothesis: Suppose that the statement is true for all natural numbers up to Template:Math.

Induction step: Consider natural number Template:Math, i.e. for positive real numbers Template:Math, there holds Template:Math. There exists at least one Template:Math, so there must be at least one Template:Math. Without loss of generality, we let Template:Math and Template:Math.

Further, the equality Template:Math we shall write in the form of Template:Math. Then, the induction hypothesis implies

(x1++xn2)+(xn1xn)>n1.

However, taking into account the induction basis, we have

x1++xn2+xn1+xn=(x1++xn2)+(xn1+xn)>(x1++xn2)+xn1xn+1>n,

which completes the proof.

For positive real numbers Template:Math, let's denote

x1=a1a1ann,...,xn=ana1ann.

The numbers Template:Math satisfy the condition Template:Math. So we have

a1a1ann++ana1annn,

whence we obtain

a1++anna1ann,

with the equality holding only for Template:Math.

Proof by Cauchy using forward–backward induction

The following proof by cases relies directly on well-known rules of arithmetic but employs the rarely used technique of forward-backward-induction. It is essentially from Augustin Louis Cauchy and can be found in his Cours d'analyse.[6]

The case where all the terms are equal

If all the terms are equal:

x1=x2==xn,

then their sum is Template:Math, so their arithmetic mean is Template:Math; and their product is Template:Math, so their geometric mean is Template:Math; therefore, the arithmetic mean and geometric mean are equal, as desired.

The case where not all the terms are equal

It remains to show that if not all the terms are equal, then the arithmetic mean is greater than the geometric mean. Clearly, this is only possible when Template:Math.

This case is significantly more complex, and we divide it into subcases.

The subcase where n = 2

If Template:Math, then we have two terms, Template:Math and Template:Math, and since (by our assumption) not all terms are equal, we have:

(x1+x22)2x1x2=14(x12+2x1x2+x22)x1x2=14(x122x1x2+x22)=(x1x22)2>0,

hence

x1+x22>x1x2

as desired.

The subcase where n = 2k

Consider the case where Template:Math, where Template:Mvar is a positive integer. We proceed by mathematical induction.

In the base case, Template:Math, so Template:Math. We have already shown that the inequality holds when Template:Math, so we are done.

Now, suppose that for a given Template:Math, we have already shown that the inequality holds for Template:Math, and we wish to show that it holds for Template:Math. To do so, we apply the inequality twice for Template:Math numbers and once for Template:Math numbers to obtain:

x1+x2++x2k2k=x1+x2++x2k12k1+x2k1+1+x2k1+2++x2k2k12x1x2x2k12k1+x2k1+1x2k1+2x2k2k12x1x2x2k12k1x2k1+1x2k1+2x2k2k1=x1x2x2k2k

where in the first inequality, the two sides are equal only if

x1=x2==x2k1

and

x2k1+1=x2k1+2==x2k

(in which case the first arithmetic mean and first geometric mean are both equal to Template:Math, and similarly with the second arithmetic mean and second geometric mean); and in the second inequality, the two sides are only equal if the two geometric means are equal. Since not all Template:Math numbers are equal, it is not possible for both inequalities to be equalities, so we know that:

x1+x2++x2k2k>x1x2x2k2k

as desired.

The subcase where n < 2k

If Template:Mvar is not a natural power of Template:Math, then it is certainly less than some natural power of 2, since the sequence Template:Math is unbounded above. Therefore, without loss of generality, let Template:Mvar be some natural power of Template:Math that is greater than Template:Mvar.

So, if we have Template:Mvar terms, then let us denote their arithmetic mean by Template:Mvar, and expand our list of terms thus:

xn+1=xn+2==xm=α.

We then have:

α=x1+x2++xnn=mn(x1+x2++xn)m=x1+x2++xn+(mn)n(x1+x2++xn)m)(x1+x2++xn=n(x1+x2++xn)n)=x1+x2++xn+(mn)αm=x1+x2++xn+xn+1++xmmx1x2xnxn+1xmm=x1x2xnαmnm,

so

αmx1x2xnαmn

and

αx1x2xnn

as desired.


Proof by induction using basic calculus

The following proof uses mathematical induction and some basic differential calculus.

Induction basis: For Template:Math the statement is true with equality.

Induction hypothesis: Suppose that the AM–GM statement holds for all choices of Template:Mvar non-negative real numbers.

Induction step: In order to prove the statement for Template:Math non-negative real numbers Template:Math, we need to prove that

x1++xn+xn+1n+1(x1xnxn+1)1n+10

with equality only if all the Template:Math numbers are equal.

If all numbers are zero, the inequality holds with equality. If some but not all numbers are zero, we have strict inequality. Therefore, we may assume in the following, that all Template:Math numbers are positive.

We consider the last number Template:Math as a variable and define the function

f(t)=x1++xn+tn+1(x1xnt)1n+1,t>0.

Proving the induction step is equivalent to showing that Template:Math for all Template:Math, with Template:Math only if Template:Math and Template:Mvar are all equal. This can be done by analyzing the critical points of Template:Mvar using some basic calculus.

The first derivative of Template:Mvar is given by

f(t)=1n+11n+1(x1xn)1n+1tnn+1,t>0.

A critical point Template:Math has to satisfy Template:Math, which means

(x1xn)1n+1t0nn+1=1.

After a small rearrangement we get

t0nn+1=(x1xn)1n+1,

and finally

t0=(x1xn)1n,

which is the geometric mean of Template:Math. This is the only critical point of Template:Mvar. Since Template:Math for all Template:Math, the function Template:Mvar is strictly convex and has a strict global minimum at Template:Math. Next we compute the value of the function at this global minimum:

f(t0)=x1++xn+(x1xn)1/nn+1(x1xn)1n+1(x1xn)1n(n+1)=x1++xnn+1+1n+1(x1xn)1n(x1xn)1n=x1++xnn+1nn+1(x1xn)1n=nn+1(x1++xnn(x1xn)1n)0,

where the final inequality holds due to the induction hypothesis. The hypothesis also says that we can have equality only when Template:Math are all equal. In this case, their geometric mean  Template:Math has the same value, Hence, unless Template:Math are all equal, we have Template:Math. This completes the proof.

This technique can be used in the same manner to prove the generalized AM–GM inequality and Cauchy–Schwarz inequality in Euclidean space Template:Math.

Proof by Pólya using the exponential function

George Pólya provided a proof similar to what follows. Let Template:Math for all real Template:Mvar, with first derivative Template:Math and second derivative Template:Math. Observe that Template:Math, Template:Math and Template:Math for all real Template:Mvar, hence Template:Mvar is strictly convex with the absolute minimum at Template:Math. Hence Template:Math for all real Template:Mvar with equality only for Template:Math.

Consider a list of non-negative real numbers Template:Math. If they are all zero, then the AM–GM inequality holds with equality. Hence we may assume in the following for their arithmetic mean Template:Math. By Template:Mvar-fold application of the above inequality, we obtain that

x1αx2αxnαex1α1ex2α1exnα1=exp(x1α1+x2α1++xnα1),(*)

with equality if and only if Template:Math for every Template:Math. The argument of the exponential function can be simplified:

x1α1+x2α1++xnα1=x1+x2++xnαn=nααn=0.

Returning to Template:Math,

x1x2xnαne0=1,

which produces Template:Math, hence the result[7]

x1x2xnnα.

Proof by Lagrangian multipliers

If any of the xi are 0, then there is nothing to prove. So we may assume all the xi are strictly positive.

Because the arithmetic and geometric means are homogeneous of degree 1, without loss of generality assume that i=1nxi=1. Set G(x1,x2,,xn)=i=1nxi, and F(x1,x2,,xn)=1ni=1nxi. The inequality will be proved (together with the equality case) if we can show that the minimum of F(x1,x2,...,xn), subject to the constraint G(x1,x2,,xn)=1, is equal to 1, and the minimum is only achieved when x1=x2==xn=1. Let us first show that the constrained minimization problem has a global minimum.

Set K={(x1,x2,,xn):0x1,x2,,xnn}. Since the intersection K{G=1} is compact, the extreme value theorem guarantees that the minimum of F(x1,x2,...,xn) subject to the constraints G(x1,x2,,xn)=1 and (x1,x2,,xn)K is attained at some point inside K. On the other hand, observe that if any of the xi>n, then F(x1,x2,,xn)>1, while F(1,1,,1)=1, and (1,1,,1)K{G=1}. This means that the minimum inside K{G=1} is in fact a global minimum, since the value of F at any point inside K{G=1} is certainly no smaller than the minimum, and the value of F at any point (y1,y2,,yn) not inside K is strictly bigger than the value at (1,1,,1), which is no smaller than the minimum.

The method of Lagrange multipliers says that the global minimum is attained at a point (x1,x2,,xn) where the gradient of F(x1,x2,,xn) is λ times the gradient of G(x1,x2,,xn), for some λ. We will show that the only point at which this happens is when x1=x2==xn=1 and F(x1,x2,...,xn)=1.

Compute Fxi=1n and

Gxi=jixj=G(x1,x2,,xn)xi=1xi

along the constraint. Setting the gradients proportional to one another therefore gives for each i that 1n=λxi, and so nλ=xi. Since the left-hand side does not depend on i, it follows that x1=x2==xn, and since G(x1,x2,,xn)=1, it follows that x1=x2==xn=1 and F(x1,x2,,xn)=1, as desired.

Generalizations

Weighted AM–GM inequality

There is a similar inequality for the weighted arithmetic mean and weighted geometric mean. Specifically, let the nonnegative numbers Template:Math and the nonnegative weights Template:Math be given. Set Template:Math. If Template:Math, then the inequality

w1x1+w2x2++wnxnwx1w1x2w2xnwnw

holds with equality if and only if all the Template:Mvar with Template:Math are equal. Here the convention Template:Math is used.

If all Template:Math, this reduces to the above inequality of arithmetic and geometric means.

One stronger version of this, which also gives strengthened version of the unweighted version, is due to Aldaz. Specifically, let the nonnegative numbers Template:Math and the nonnegative weights Template:Math be given. Assume further that the sum of the weights is 1. Then

i=1nwixii=1nxiwi+i=1nwi(xi12i=1nwixi12)2.[8]

Proof using Jensen's inequality

Using the finite form of Jensen's inequality for the natural logarithm, we can prove the inequality between the weighted arithmetic mean and the weighted geometric mean stated above.

Since an Template:Mvar with weight Template:Math has no influence on the inequality, we may assume in the following that all weights are positive. If all Template:Mvar are equal, then equality holds. Therefore, it remains to prove strict inequality if they are not all equal, which we will assume in the following, too. If at least one Template:Mvar is zero (but not all), then the weighted geometric mean is zero, while the weighted arithmetic mean is positive, hence strict inequality holds. Therefore, we may assume also that all Template:Mvar are positive.

Since the natural logarithm is strictly concave, the finite form of Jensen's inequality and the functional equations of the natural logarithm imply

ln(w1x1++wnxnw)>w1wlnx1++wnwlnxn=lnx1w1x2w2xnwnw.

Since the natural logarithm is strictly increasing,

w1x1++wnxnw>x1w1x2w2xnwnw.

Matrix arithmetic–geometric mean inequality

Most matrix generalizations of the arithmetic geometric mean inequality apply on the level of unitarily invariant norms, since, even if the matrices A and B are positive semi-definite, the matrix AB may not be positive semi-definite and hence may not have a canonical square root. In [9] Bhatia and Kittaneh proved that for any unitarily invariant norm |||||| and positive semi-definite matrices A and B it is the case that

|||AB|||12|||A2+B2|||

Later, in [10] the same authors proved the stronger inequality that

|||AB|||14|||(A+B)2|||

Finally, it is known for dimension n=2 that the following strongest possible matrix generalization of the arithmetic-geometric mean inequality holds, and it is conjectured to hold for all n

|||(AB)12|||12|||A+B|||

This conjectured inequality was shown by Stephen Drury in 2012. Indeed, he proved[11]

σj(AB)12λj(A+B), j=1,,n.

In finance much research is concerned with accurately estimating the rate of return of an asset over multiple periods in the future. In the case of lognormal asset returns, there is an exact formula to compute the arithmetic asset return from the geometric asset return.

For simplicity, assume we are looking at yearly geometric returns Template:Math over a time horizon of Template:Mvar years, i.e.

rn=VnVn1Vn1,

where:

Vn = value of the asset at time n,
Vn1 = value of the asset at time n1.

The geometric and arithmetic returns are respectively defined as

gN=(n=1N(1+rn))1/N,
aN=1Nn=1Nrn.

When the yearly geometric asset returns are lognormally distributed, then the following formula can be used to convert the geometric average return to the arithemtic average return:[12]

1+gN=1+aN1+σ2(1+aN)2,

where σ2 is the variance of the observed asset returns This implicit equation for Template:Mvar can be solved exactly as follows. First, notice that by setting

z=(1+aN)2,

we obtain a polynomial equation of degree 2:

z2(1+g)2(1+g)2σ2=0.

Solving this equation for Template:Mvar and using the definition of Template:Mvar, we obtain 4 possible solutions for Template:Mvar:

aN=±1+gN21±1+4σ2(1+gN)21.

However, notice that

1+4σ2(1+gN)21.

This implies that the only 2 possible solutions are (as asset returns are real numbers):

aN=±1+gN21+1+4σ2(1+gN)21.

Finally, we expect the derivative of Template:Mvar with respect to Template:Mvar to be non-negative as an increase in the geometric return should never cause a decrease in the arithmetic return. Indeed, both measure the average growth of an asset's value and therefore should move in similar directions. This leaves us with one solution to the implicit equation for Template:Mvar, namely

aN=1+gN21+1+4σ2(1+gN)21.

Therefore, under the assumption of lognormally distributed asset returns, the arithmetic asset return is fully determined by the geometric asset return.

Other generalizations

Template:QM AM GM HM inequality visual proof.svg Other generalizations of the inequality of arithmetic and geometric means include:

See also

Notes

Template:Notelist Template:Reflist

References

Template:Reflist

  1. Template:Citation
  2. Template:Cite web
  3. Template:Cite book
  4. Template:Cite book
  5. Aaron Potechin, Sum of Squares seminar, University of Chicago, "Lecture 5: SOS Proofs and the Motzkin Polynomial", slide 25
  6. Cauchy, Augustin-Louis (1821). Cours d'analyse de l'École Royale Polytechnique, première partie, Analyse algébrique, Paris. The proof of the inequality of arithmetic and geometric means can be found on pages 457ff.
  7. Template:Cite book
  8. Template:Cite journal
  9. Template:Cite journal
  10. Template:Cite journal
  11. S.W. Drury, On a question of Bhatia and Kittaneh, Linear Algebra Appl. 437 (2012) 1955–1960.
  12. Template:Cite journal
  13. cf. Iordanescu, R.; Nichita, F.F.; Pasarescu, O. Unification Theories: Means and Generalized Euler Formulas. Axioms 2020, 9, 144.