Shapley–Folkman lemma

From testwiki
Jump to navigation Jump to search

Template:Short description Template:Bots Template:Use dmy dates Template:CS1 config

The Shapley–Folkman lemma depicted by a diagram with two panes, one on the left and the other on the right. The left-hand pane displays four sets, which are displayed in a two-by-two array. Each of the sets contains exactly two points, which are displayed in red. In each set, the two points are joined by a pink line-segment, which is the convex hull of the original set. Each set has exactly one point that is indicated with a plus-symbol. In the top row of the two-by-two array, the plus-symbol lies in the interior of the line segment; in the bottom row, the plus-symbol coincides with one of the red-points. This completes the description of the left-hand pane of the diagram. The right-hand pane displays the Minkowski sum of the sets, which is the union of the sums having exactly one point from each summand-set; for the displayed sets, the sixteen sums are distinct points, which are displayed in red: The right-hand red sum-points are the sums of the left-hand red summand-points. The convex hull of the sixteen red-points is shaded in pink. In the pink interior of the right-hand sumset lies exactly one plus-symbol, which is the (unique) sum of the plus-symbols from the right-hand side. Comparing the left array and the right pane, one confirms that the right-hand plus-symbol is indeed the sum of the four plus-symbols from the left-hand sets, precisely two points from the original non-convex summand-sets and two points from the convex hulls of the remaining summand-sets.
The Shapley–Folkman lemma is illustrated by the Minkowski addition of four sets. The point (+) in the convex hull of the Minkowski sum of the four non-convex sets (right) is the sum of four points (+) from the (left-hand) sets—two points in two non-convex sets plus two points in the convex hulls of two sets. The convex hulls are shaded pink. The original sets each have exactly two points (shown as red dots).[1]

The Shapley–Folkman lemma is a result in convex geometry that describes the Minkowski addition of sets in a vector space. The lemma may be intuitively understood as saying that, if the number of summed sets exceeds the dimension of the vector space, then their Minkowski sum is approximately convex.[1][2] It is named after mathematicians Lloyd Shapley and Jon Folkman, but was first published by the economist Ross M. Starr.

Related results provide more refined statements about how close the approximation is. For example, the Shapley–Folkman theorem provides an upper bound on the distance between any point in the Minkowski sum and its convex hull. This upper bound is sharpened by the Shapley–Folkman–Starr theorem (alternatively, Starr's corollary).[3]

The Shapley–Folkman lemma has applications in economics, optimization and probability theory.[3] In economics, it can be used to extend results proved for convex preferences to non-convex preferences. In optimization theory, it can be used to explain the successful solution of minimization problems that are sums of many functions.[4][5] In probability, it can be used to prove a law of large numbers for random sets.[6] Template:TOC limit

Introductory example

A set is said to be convex if every line segment joining two of its points is a subset in the set. The solid disk ∙ is a convex set, but the circle ∘ is not, because the line segment joining two distinct points ⊘ is not a subset of the circle.Template:Sfnp The convex hull of a set Q is the smallest convex set that contains Q.Template:Sfnp

Minkowski addition is an operation on sets that forms the set of sums of members of the sets, with one member from each set.Template:Sfnp For example, adding the set consisting of the integers zero and one to itself yields the set consisting of zero, one, and two:{0,1}+{0,1}={0+0,0+1,1+0,1+1}={0,1,2}. This subset of the integers {0,1,2} is contained in the interval of real numbers [0,2], which is its convex hull. The Shapley–Folkman lemma implies that every point in [0,2] is the sum of an integer from {0,1} and a real number from [0,1]: to get the convex hull of the Minkowski sum of {0,1} with itself, only one of the summands needs to be replaced by its convex hull.Template:Sfnp

The non-convex set {0,1} and its convex hull [0,1] are at Hausdorff distance 12 from each other, and this distance remains the same for the non-convex set {0,1,2} and its convex hull [0,2]. In both cases the convex hull contains points such as 12 that are at distance 12 from the members of the non-convex set. In this example, the Minkowski sum operation does not decrease the distance between the sum and its convex hull. But when summing is replaced by averaging, by scaling the sum by the number of terms in the sum, the distance between the scaled Minkowski sum and its convex hull does go down. The distance between the average Minkowski sum 12({0,1}+{0,1})={0,12,1} and its convex hull [0,1] is only 14, which is half the distance 12 between its summand {0,1} and its convex hull [0,1]. As more sets are added together, the average of their sum "fills out" its convex hull: The maximum distance between the average and its convex hull approaches zero as the average includes more summands. This reduction in distance can be stated more formally as the Shapley–Folkman theorem and Shapley–Folkman–Starr theorem, as consequences of the Shapley–Folkman lemma.Template:Sfnp

Preliminaries

The Shapley–Folkman lemma depends upon the following definitions and results from convex geometry.

Real vector spaces

A real vector space of two dimensions can be given a Cartesian coordinate system in which every point is identified by an ordered pair of real numbers, called "coordinates", which are conventionally denoted by x and y. Two points in the Cartesian plane can be added coordinate-wise: (x1,y1)+(x2,y2)=(x1+x2,y1+y2); further, a point can be multiplied by each real number λ coordinate-wise: λ(x,y)=(λx,λy).

More generally, any real vector space of (finite) dimension D can be viewed as the set of all D-tuples of D real numbers (x1,x2,…,xD) on which two operations are defined: vector addition and multiplication by a real number. For finite-dimensional vector spaces, the operations of vector addition and real-number multiplication can each be defined coordinate-wise, following the example of the Cartesian plane.[7]

Convex sets

Template:Multiple image

In a real vector space, a non-empty set Q is defined to be convex if, for each pair of its points, every point on the line segment that joins them is still in Q. For example, a solid disk ∙ is convex but a circle ∘ is not, because it does not contain a line segment joining opposite points.Template:Sfnp A solid cube is convex; however, anything that is hollow or dented, for example, a crescent shape, is non-convex. The empty set is convex, either by definitionTemplate:Sfnp or vacuously.Template:Sfnp

More formally, a set Q is convex if, for all points q1 and q2 in Q and for every real number λ in the unit interval [0,1], the point (1−λ)q1+λq2 is a member of Q. By mathematical induction, a set Q is convex if and only if every convex combination of members of Q also belongs to Q. By definition, a convex combination of indexed points v1,v2,…vD of a vector space is any weighted average λ1v1+λ2v2+⋯+λDvD for indexed real numbers λ1,λ2,…λD satisfying the equation λ1+λ2+⋯+λD=1.[8]

The definition of a convex set implies that the intersection of two convex sets is a convex set. More generally, the intersection of a family of convex sets is a convex set. In particular, the intersection of two disjoint sets is the empty set, which is convex.Template:Sfnp

Convex hull

A picture of a smoothed triangle, like a triangular (Mexican) tortilla-chip or a triangular road-sign. Each of the three rounded corners is drawn with a red curve. The remaining interior points of the triangular shape are shaded with blue.
In the convex hull of the red set, each blue point is a convex combination of some red points.

For every subset Q of a real vector space, its convex hull conv⁡Q is the minimal convex set that contains Q. Thus conv⁡Q is the intersection of all the convex sets that cover Q.Template:Sfnp The convex hull of a set can be equivalently defined to be the set of all convex combinations of points in Q.[9] For example, the convex hull of the set of integers {0,1} is the closed interval of real numbers [0,1], which has the maximum and minimum of the given set as its endpoints.Template:Sfnp The convex hull of the unit circle is the closed unit disk, which contains the unit circle and its interior.Template:Sfnp

Minkowski addition

Three squares are shown in the non-negative quadrant of the Cartesian plane.
Minkowski addition of sets. The sum of the squares Q1=[0,1]2 and Q2=[1,2]2 is the square Q1+Q2=[1,3]2.

In any vector space (or algebraic structure with addition), X, the Minkowski sum of two non-empty sets A,B⊆X is defined to be the element-wise operation[10] A+B={x+y∣x∈A,y∈B}. For example, {0,1}+{0,1}={0+0,0+1,1+0,1+1}={0,1,2}. This operation is clearly commutative and associative on the collection of non-empty sets. All such operations extend in a well-defined manner to recursive forms ∑n=1NQn=Q1+Q2+…+QN. By the principle of induction,[11] ∑n=1NQn={∑n=1Nqn|qn∈Qn,1≤n≤N}.

Convex hulls of Minkowski sums

Minkowski addition behaves well with respect to taking convex hulls. Specifically, for all subsets A,B⊆X of a real vector space, X, the convex hull of their Minkowski sum is the Minkowski sum of their convex hulls. That is, conv⁡(A+B)=(conv⁡A)+(conv⁡B). And by induction it follows that conv⁡∑n=1NQn=∑n=1Nconv⁡Qn for any N∈ℕ and non-empty subsets Qn∈X, 1≤n≤N.[12][13]

Statements of the three main results

Notation

In the following statements, D and N represent positive integers. D is the dimension of the ambient space ℝD.

Q1,…,QN represent nonempty, bounded subsets of ℝD. They are also called "summands". N is the number of summands.

Q=∑n=1NQn denotes the Minkowski sum of the summands.

The variable x is used to represent an arbitrary vector in conv⁡Q.

Shapley–Folkman lemma

Because the convex hull and Minkowski sum operations can always be interchanged, as conv⁡Q=∑n=1Nconv⁡(Qn), it follows that for every x∈conv⁡Q, there exist elements qn∈conv⁡Qn such that ∑n=1Nqn=x. The Shapley–Folkman lemma refines this statement.Template:Sfnp

Template:Math theorem

For example, every point in [0,2]=[0,1]+[0,1]=conv⁡{0,1}+conv⁡{0,1} is the sum of an element in {0,1} and an element in [0,1].Template:Sfnp

Shuffling indices if necessary, this means that every point in conv⁡Q can be decomposed as

x=∑n=1Dqn+∑n=D+1Nqn

where qn∈conv⁡Qn for 1≤n≤D and qn∈Qn for D+1≤n≤N. Note that the reindexing depends on the point x.[14]

The lemma may be stated succinctly as

conv⁡(∑n=1NQn)⊆⋃I⊆{1,2,…N}:|I|=D(∑n∈Iconv⁡Qn+∑n∉IQn).

The converse of Shapley–Folkman lemma

Template:Math theorem

In particular, the Shapley–Folkman lemma requires the vector space to be finite-dimensional.[15]

Shapley–Folkman theorem

Shapley and Folkman used their lemma to prove the following theorem, which quantifies the difference between Q and conv⁡Q using Hausdorff distance. Hausdorff distances measure how close two sets are. For two sets X and Y, the Hausdorff distance is, intuitively, the smallest amount by which each must be expanded to cover the other. More formally, if the distance from a point x to a set Y is defined as the infimum of pairwise distances, d(x,Y)=infy∈Y‖x−y‖, then let Xε denote the set of all points within distance ε of X; equivalently this is closure of the Minkowski sum of X with a ball of radius ε. Then for X⊂Y, the Hausdorff distance is[16] dH(X,Y)=inf⁡{ε∣Xε⊃Y}.

The Shapley–Folkman theorem quantifies how close to convexity Q is by upper-bounding its Hausdorff distance to conv⁡Q, using the circumradii of its constituent sets. For any bounded set S⊂ℝD, define its circumradius rad⁡S to be the smallest radius of a ball containing it. More formally, letting x denote the center of the smallest enclosing ball, it can be defined asTemplate:Sfnp rad⁡S=inf⁡{ε∣∃x∈ℝN:{x}ε⊃S}. With this notation in place, the Shapley–Folkman theorem can be stated as:

Template:Math theorem

Here the notation ∑max⁡D means "the sum of the D largest terms". This upper bound depends on the dimension of ambient space and the shapes of the summands, but not on the number of summands.Template:Sfnp

Shapley–Folkman–Starr theorem

A blue disk contains red points. A smaller green disk sits in the largest concavity in among these red points.
The circumradius (blue) and inner radius (green) of a point set (dark red, with its convex hull shown as the lighter red dashed lines). The inner radius is smaller than the circumradius except for subsets of a single circle, for which they are equal.

The Shapley–Folkman theorem can be strengthened by replacing the circumradius of the terms in a Minkowski by a smaller value, the inner radius, which intuitively measures the radius of the holes in a set rather than the radius of a set. Define the inner radius r(S) of a bounded subset S⊂ℝD to be the infimum of r such that, for any x∈conv⁡S, there exists a ball B of radius r such that x∈conv⁡(S∩B).[17]

Template:Math theorem

Proofs

There have been many proofs of these results, from the original,[17] to the later Arrow and Hahn,[18] Cassels,[19] Schneider,[20] etc. An abstract and elegant proof by Ekeland[21] has been extended by Artstein.[22] Different proofs have also appeared in unpublished papers.[2]Template:Sfnp An elementary proof of the Shapley–Folkman lemma can be found in the book by Bertsekas, together with applications in estimating the duality gap in separable optimization problems and zero-sum games.Template:Sfnp

Usual proofs of these results are nonconstructive: they establish only the existence of the representation, but do not provide an algorithm for computing the representation. In 1981, Starr published an iterative algorithm for a less sharp version of the Shapley–Folkman–Starr theorem.Template:Sfnp

Via Carathéodory's theorem

The following proof of Shapley–Folkman lemma is from Template:Harvtxt. The proof idea is to lift the representation of x from ℝDto ℝD+N, use Carathéodory's theorem for conic hulls, then drop back to ℝD.Template:Sfnp

Template:Math proof

Probabilistic

The following "probabilistic" proof of Shapley–Folkman–Starr theorem is from Template:Harvtxt.[19]

We can interpret conv⁡S in probabilistic terms: ∀x∈conv⁡S, since x=∑wnqn for some qn∈S, we can define a random vector X, finitely supported in S, such that Pr(X=qn)=wn, and x=𝔼[X].

Then, it is natural to consider the "variance" of a set S asVar⁡(S):=supx∈conv⁡Sinf𝔼[X]=x,X is finitely supported in SVar⁡[X]With that, d(S,conv⁡(S))2≤Var⁡(S)≤r(S)≤rad(S).Template:Math proofTemplate:Math proof

History

Picture of Lloyd Shapley
A Winner of the 2012 Nobel Award in Economics, Lloyd Shapley proved the Shapley–Folkman lemma with Jon Folkman.[1]

The lemma of Lloyd Shapley and Jon Folkman was firstTemplate:Sfnp published by the economist Ross M. Starr, who was investigating the existence of economic equilibria while studying with Kenneth Arrow. In his paper, Starr studied a convexified economy, in which non-convex sets were replaced by their convex hulls; Starr proved that the convexified economy has equilibria that are closely approximated by "quasi-equilibria" of the original economy; moreover, he proved that every quasi-equilibrium has many of the optimal properties of true equilibria, which are proved to exist for convex economies.[1]

Following Starr's 1969 paper, the Shapley–Folkman–Starr results have been widely used to show that central results of (convex) economic theory are good approximations to large economies with non-convexities; for example, quasi-equilibria closely approximate equilibria of a convexified economy. "The derivation of these results in general form has been one of the major achievements of postwar economic theory", wrote Roger Guesnerie.[23]

Applications

The Shapley–Folkman lemma enables researchers to extend results for Minkowski sums of convex sets to sums of general sets, which need not be convex. Such sums of sets arise in economics, in mathematical optimization, and in probability theory; in each of these three mathematical sciences, non-convexity is an important feature of applications.

Economics

The nonnegative quadrant of the Cartesian plane appears. A blue straight-line slopes downward as a secant joining two points, one on each of the axes. This blue line is tangent to a red curve that touches it at a marked point, whose coordinates are labeled Qx and Qy.
The consumer prefers every basket of goods on the indifference curve I3 over each basket on  I2. The basket (Qx, Qy), where the budget line (shown in blue) supports I2, is optimal and also feasible, unlike any basket lying on  I3 which is preferred but unfeasible.

Template:See also In economics, a consumer's preferences are defined over all "baskets" of goods. Each basket is represented as a non-negative vector, whose coordinates represent the quantities of the goods. On this set of baskets, an indifference curve is defined for each consumer; a consumer's indifference curve contains all the baskets of commodities that the consumer regards as equivalent: That is, for every pair of baskets on the same indifference curve, the consumer does not prefer one basket over another. Through each basket of commodities passes one indifference curve. A consumer's preference set (relative to an indifference curve) is the union of the indifference curve and all the commodity baskets that the consumer prefers over the indifference curve. A consumer's preferences are convex if all such preference sets are convex.[24]

An optimal basket of goods occurs where the budget-line supports a consumer's preference set, as shown in the diagram. This means that an optimal basket is on the highest possible indifference curve given the budget-line, which is defined in terms of a price vector and the consumer's income (endowment vector). Thus, the set of optimal baskets is a function of the prices, and this function is called the consumer's demand. If the preference set is convex, then at every price the consumer's demand is a convex set, for example, a unique optimal basket or a line-segment of baskets.[25]

Non-convex preferences

Image of a non-convex preference set with a concavity un-supported by the budget line
When the consumer's preferences have concavities, the consumer may jump between two separate optimal baskets.

Template:See also However, if a preference set is non-convex, then some prices determine a budget-line that supports two separate optimal-baskets. For example, we can imagine that, for zoos, a lion costs as much as an eagle, and further that a zoo's budget suffices for one eagle or one lion. We can suppose also that a zoo-keeper views either animal as equally valuable. In this case, the zoo would purchase either one lion or one eagle. Of course, a contemporary zoo-keeper does not want to purchase half of an eagle and half of a lion (or a griffin)! Thus, the zoo-keeper's preferences are non-convex: The zoo-keeper prefers having either animal to having any strictly convex combination of both.[26]

When the consumer's preference set is non-convex, then (for some prices) the consumer's demand is not connected; a disconnected demand implies some discontinuous behavior by the consumer, as discussed by Harold Hotelling:

If indifference curves for purchases be thought of as possessing a wavy character, convex to the origin in some regions and concave in others, we are forced to the conclusion that it is only the portions convex to the origin that can be regarded as possessing any importance, since the others are essentially unobservable. They can be detected only by the discontinuities that may occur in demand with variation in price-ratios, leading to an abrupt jumping of a point of tangency across a chasm when the straight line is rotated. But, while such discontinuities may reveal the existence of chasms, they can never measure their depth. The concave portions of the indifference curves and their many-dimensional generalizations, if they exist, must forever remain in unmeasurable obscurity.[27]

The difficulties of studying non-convex preferences were emphasized by Herman Wold[28] and again by Paul Samuelson, who wrote that non-convexities are "shrouded in eternal darkness",[29]Template:Efn according to Diewert.[30]

Nonetheless, non-convex preferences were illuminated from 1959 to 1961 by a sequence of papers in The Journal of Political Economy (JPE). The main contributors were Farrell,[31] Bator,[32] Koopmans,[33] and Rothenberg.[34] In particular, Rothenberg's paper discussed the approximate convexity of sums of non-convex sets.[35] These JPE-papers stimulated a paper by Lloyd Shapley and Martin Shubik, which considered convexified consumer-preferences and introduced the concept of an "approximate equilibrium".[36] The JPE-papers and the Shapley–Shubik paper influenced another notion of "quasi-equilibria", due to Robert Aumann.[37][38]

Starr's 1969 paper and contemporary economics

Picture of Kenneth Arrow
Kenneth Arrow (1972 Nobel laureate) helped Ross M. Starr to study non-convex economies.[39]

Previous publications on non-convexity and economics were collected in an annotated bibliography by Kenneth Arrow. He gave the bibliography to Starr, who was then an undergraduate enrolled in Arrow's (graduate) advanced mathematical-economics course.[39] In his term-paper, Starr studied the general equilibria of an artificial economy in which non-convex preferences were replaced by their convex hulls. In the convexified economy, at each price, the aggregate demand was the sum of convex hulls of the consumers' demands. Starr's ideas interested the mathematicians Lloyd Shapley and Jon Folkman, who proved their eponymous lemma and theorem in "private correspondence", which was reported by Starr's published paper of 1969.[1]

In his 1969 publication, Starr applied the Shapley–Folkman–Starr theorem. Starr proved that the "convexified" economy has general equilibria that can be closely approximated by "quasi-equilibria" of the original economy, when the number of agents exceeds the dimension of the goods: Concretely, Starr proved that there exists at least one quasi-equilibrium of prices popt with the following properties:

  • For each quasi-equilibrium's prices popt, all consumers can choose optimal baskets (maximally preferred and meeting their budget constraints).
  • At quasi-equilibrium prices popt in the convexified economy, every good's market is in equilibrium: Its supply equals its demand.
  • For each quasi-equilibrium, the prices "nearly clear" the markets for the original economy: an upper bound on the distance between the set of equilibria of the "convexified" economy and the set of quasi-equilibria of the original economy followed from Starr's corollary to the Shapley–Folkman theorem.[40]

Starr established that

"in the aggregate, the discrepancy between an allocation in the fictitious economy generated by [taking the convex hulls of all of the consumption and production sets] and some allocation in the real economy is bounded in a way that is independent of the number of economic agents. Therefore, the average agent experiences a deviation from intended actions that vanishes in significance as the number of agents goes to infinity".[41]

Following Starr's 1969 paper, the Shapley–Folkman–Starr results have been widely used in economic theory. Roger Guesnerie summarized their economic implications: "Some key results obtained under the convexity assumption remain (approximately) relevant in circumstances where convexity fails. For example, in economies with a large consumption side, preference nonconvexities do not destroy the standard results".[42] "The derivation of these results in general form has been one of the major achievements of postwar economic theory", wrote Guesnerie.[23] The topic of non-convex sets in economics has been studied by many Nobel laureates: Arrow (1972), Robert Aumann (2005), Gérard Debreu (1983), Tjalling Koopmans (1975), Paul Krugman (2008), and Paul Samuelson (1970); the complementary topic of convex sets in economics has been emphasized by these laureates, along with Leonid Hurwicz, Leonid Kantorovich (1975), and Robert Solow (1987).[43] The Shapley–Folkman–Starr results have been featured in the economics literature: in microeconomics,[44] in general-equilibrium theory,[45] in public economicsTemplate:Sfnp (including market failures),[46] as well as in game theory,[47] in mathematical economics,[48] and in applied mathematics (for economists).[49][50] The Shapley–Folkman–Starr results have also influenced economics research using measure and integration theory.[51]

Mathematical optimization

A graph of a convex function, which is drawn in black. Its epigraph, the area above its graph, is solid green.
A function is convex if the region above its graph is a convex set.

The Shapley–Folkman lemma has been used to explain why large minimization problems with non-convexities can be nearly solved (with iterative methods whose convergence proofs are stated for only convex problems). The Shapley–Folkman lemma has encouraged the use of methods of convex minimization on other applications with sums of many functions.[52]

Preliminaries of optimization theory

Nonlinear optimization relies on the following definitions for functions:

  • The graph of a function f is the set of the pairs of arguments x and function evaluations f(x)
Graph(f) = { (x, f(x) ) }
A graph of the sine function, which periodically oscillates up and down between −1 and +1, with the period 2π.
The sine function is non-convex.
Epi(f) = { (x, u) : f(x) ≤ u }.

For example, the quadratic function f(x) = x2 is convex, as is the absolute value function g(x) = |x|. However, the sine function (pictured) is non-convex on the interval (0, π).

Additive optimization problems

In many optimization problems, the objective function f is separable: that is, f is the sum of many summand-functions, each of which has its own argument: f(x)=f((x1,…,xN))=∑fn(xn).

For example, problems of linear optimization are separable. Given a separable problem with an optimal solution, fix an optimal solution xmin=(x1,…,xN)min with the minimum value f(xmin). For this separable problem, consider an optimal solution (xmin,f(xmin)) to the convexified problem, where convex hulls are taken of the graphs of the summand functions. Such an optimal solution is the limit of a sequenceTemplate:Efn of points in the convexified problem (xj,f(xj))∈∑conv⁡Graph⁡(fn). The given optimal-point is a sum of points in the graphs of the original summands and of a small number of convexified summands, by the Shapley–Folkman lemma.[4]

This analysis was published by Ivar Ekeland in 1974 to explain the apparent convexity of separable problems with many summands, despite the non-convexity of the summand problems. In 1973, the young mathematician Claude Lemaréchal was surprised by his success with convex minimization methods on problems that were known to be non-convex; for minimizing nonlinear problems, a solution of the dual problem need not provide useful information for solving the primal problem, unless the primal problem be convex and satisfy a constraint qualification. Lemaréchal's problem was additively separable, and each summand function was non-convex; nonetheless, a solution to the dual problem provided a close approximation to the primal problem's optimal value.[54][4][55] Ekeland's analysis explained the success of methods of convex minimization on large and separable problems, despite the non-convexities of the summand functions. Ekeland and later authors argued that additive separability produced an approximately convex aggregate problem, even though the summand functions were non-convex. The crucial step in these publications is the use of the Shapley–Folkman lemma.[4][55][56] Template:Efn The Shapley–Folkman lemma has encouraged the use of methods of convex minimization on other applications with sums of many functions.[4][5][49][52]

Probability and measure theory

Convex sets are often studied with probability theory. Each point in the convex hull of a (non-empty) subset Q of a finite-dimensional space is the expected value of a simple random vector that takes its values in Q, as a consequence of Carathéodory's lemma. Thus, for a non-empty set Q, the collection of the expected values of the simple, Q-valued random vectors equals QTemplate:'s convex hull; this equality implies that the Shapley–Folkman–Starr results are useful in probability theory.[57] In the other direction, probability theory provides tools to examine convex sets generally and the Shapley–Folkman–Starr results specifically.[58] The Shapley–Folkman–Starr results have been widely used in the probabilistic theory of random sets,[59] for example, to prove a law of large numbers,[6][60] a central limit theorem,[60][61] and a large-deviations principle.[62] These proofs of probabilistic limit theorems used the Shapley–Folkman–Starr results to avoid the assumption that all the random sets be convex.

A probability measure is a finite measure, and the Shapley–Folkman lemma has applications in non-probabilistic measure theory, such as the theories of volume and of vector measures. The Shapley–Folkman lemma enables a refinement of the Brunn–Minkowski inequality, which bounds the volume of sums in terms of the volumes of their summand-sets.[63] The volume of a set is defined in terms of the Lebesgue measure, which is defined on subsets of Euclidean space. In advanced measure-theory, the Shapley–Folkman lemma has been used to prove Lyapunov's theorem, which states that the range of a vector measure is convex.[64] Here, the traditional term "range" (alternatively, "image") is the set of values produced by the function. A vector measure is a vector-valued generalization of a measure; for example, if p1 and p2 are probability measures defined on the same measurable space, then the product function Template:Nowrap is a vector measure, where Template:Nowrap is defined for every event ω by

(p1 p2)(ω)=(p1(ω), p2(ω)).

Lyapunov's theorem has been used in economics,[37][65] in ("bang-bang") control theory, and in statistical theory.[66] Lyapunov's theorem has been called a continuous counterpart of the Shapley–Folkman lemma,[3] which has itself been called a discrete analogue of Lyapunov's theorem.[67] Template:Clear

Notes

Template:Notelist

Footnotes

Template:Reflist

References

Template:Refbegin

Template:Refend

Template:Geometry-footer Template:Microeconomics Template:Convex analysis and variational analysis

Template:Good article

  1. ↑ 1.0 1.1 1.2 1.3 1.4 Template:Harvtxt
  2. ↑ 2.0 2.1 Template:Harvtxt
  3. ↑ 3.0 3.1 3.2 Template:Harvtxt
  4. ↑ 4.0 4.1 4.2 4.3 4.4 Template:Harvtxt: Published in the first English edition of 1976, Ekeland's appendix proves the Shapley–Folkman lemma, also acknowledging Lemaréchal's experiments on page 373.
  5. ↑ 5.0 5.1 Template:Harvtxt acknowledging Template:Harvtxt on page 374 and Template:Harvtxt on page 381:

    Template:Harvtxt describes an application of Lagrangian dual methods to the scheduling of electrical power plants ("unit commitment problems"), where non-convexity appears because of integer constraints:

    Template:Harvtxt

  6. ↑ 6.0 6.1 Template:Harvtxt
  7. ↑ Template:Harvtxt
  8. ↑ Template:Harvtxt, Template:Harvtxt, and Template:Harvtxt
  9. ↑ Template:Harvtxt and Template:Harvtxt
  10. ↑ Template:Harvtxt and Template:Harvtxt
  11. ↑ Template:Harvtxt and Template:Harvtxt
  12. ↑ Template:Harvtxt
  13. ↑ Template:Harvtxt
  14. ↑ Template:Harvtxt
  15. ↑ Cite error: Invalid <ref> tag; no text was provided for refs named "converse".
  16. ↑ Template:Harvtxt. The formula for Hausdorff distance is simplified here using the assumption that X⊂Y to avoid requiring also that X⊂Yε.
  17. ↑ 17.0 17.1 Template:Harvtxt
  18. ↑ Template:Harvtxt
  19. ↑ 19.0 19.1 Template:Harvtxt
  20. ↑ Template:Harvtxt
  21. ↑ Template:Harvtxt
  22. ↑ Template:Harvtxt
  23. ↑ 23.0 23.1 Template:Harvtxt
  24. ↑ Template:Harvtxt and Template:Harvtxt
  25. ↑ Template:Harvtxt
  26. ↑ Template:Harvtxt: "After all, one may be indifferent between an automobile and a boat, but in most cases one can neither drive nor sail the combination of half boat, half car."
  27. ↑ Template:Harvtxt
  28. ↑ Template:Harvtxt and Template:Harvtxt
  29. ↑ Template:Harvtxt:

    It will be noted that any point where the indifference curves are convex rather than concave cannot be observed in a competitive market. Such points are shrouded in eternal darkness—unless we make our consumer a monopsonist and let him choose between goods lying on a very convex "budget curve" (along which he is affecting the price of what he buys). In this monopsony case, we could still deduce the slope of the man's indifference curve from the slope of the observed constraint at the equilibrium point.

  30. ↑ Template:Harvtxt
  31. ↑ Template:Harvs
  32. ↑ Template:Harvs
  33. ↑ Template:Harvtxt and others—for example, Template:Harvtxt and Template:Harvtxt, Template:Harvtxt, Template:Harvtxt, and Template:Harvtxt—commented on Template:Harvtxt
  34. ↑ Template:Harvs
  35. ↑ Template:Harvtxt
  36. ↑ Template:Harvtxt
  37. ↑ 37.0 37.1 Template:Harvtxt uses results from Template:Harvs
  38. ↑ Taking the convex hull of non-convex preferences had been discussed earlier by Template:Harvtxt and by Template:Harvtxt, according to Template:Harvtxt.
  39. ↑ 39.0 39.1 Template:Harvtxt
  40. ↑ Template:Harvtxt and Template:Harvtxt
  41. ↑ Template:Harvtxt
  42. ↑ Template:Harvtxt
  43. ↑ Template:Harvtxt
  44. ↑ Template:Harvtxt

    Template:Harvtxt

  45. ↑ Template:Harvtxt

    Template:Harvtxt

    Template:Harvtxt

    Template:Harvtxt

    Template:Harvtxt

  46. ↑ Template:Harvtxt
  47. ↑ Template:Harvtxt
  48. ↑ Template:Harvtxt
  49. ↑ 49.0 49.1 Template:Harvtxt
  50. ↑ Template:Harvtxt
  51. ↑ Template:Harvtxt
  52. ↑ 52.0 52.1 Template:Harvtxt
  53. ↑ Template:Harvtxt
  54. ↑ Template:Harvtxt Lemaréchal's experiments were discussed in later publications:

    Template:Harvtxt

    Template:Harvtxt

  55. ↑ 55.0 55.1 Template:Harvtxt
  56. ↑ Template:Harvtxt
  57. ↑ Template:Harvtxt
  58. ↑ Template:Harvtxt
  59. ↑ Template:Harvtxt
  60. ↑ 60.0 60.1 Template:Harvtxt
  61. ↑ Template:Harvtxt
  62. ↑ Template:Harvtxt uses applications of the Shapley–Folkman lemma from Template:Harvtxt.
  63. ↑ Template:Harvtxt
  64. ↑ Template:Harvtxt
  65. ↑ Template:Harvtxt was noted by the winner of the 1983 Nobel Prize in Economics, Gérard Debreu. Template:Harvtxt wrote:

    The concept of a convex set (i.e., a set containing the segment connecting any two of its points) had repeatedly been placed at the center of economic theory before 1964. It appeared in a new light with the introduction of integration theory in the study of economic competition: If one associates with every agent of an economy an arbitrary set in the commodity space and if one averages those individual sets over a collection of insignificant agents, then the resulting set is necessarily convex. [Debreu appends this footnote: "On this direct consequence of a theorem of A. A. Lyapunov, see Template:Harvtxt."] But explanations of the ... functions of prices ... can be made to rest on the convexity of sets derived by that averaging process. Convexity in the commodity space obtained by aggregation over a collection of insignificant agents is an insight that economic theory owes ... to integration theory. [Italics added]

  66. ↑ Template:Harvtxt
  67. ↑ Template:Harvtxt