Function of several real variables
Template:Short description Template:More footnotes Template:Functions
In mathematical analysis and its applications, a function of several real variables or real multivariate function is a function with more than one argument, with all arguments being real variables. This concept extends the idea of a function of a real variable to several variables. The "input" variables take real values, while the "output", also called the "value of the function", may be real or complex. However, the study of the complex-valued functions may be easily reduced to the study of the real-valued functions, by considering the real and imaginary parts of the complex function; therefore, unless explicitly specified, only real-valued functions will be considered in this article.
The domain of a function of Template:Mvar variables is the subset of Template:Tmath for which the function is defined. As usual, the domain of a function of several real variables is supposed to contain a nonempty open subset of Template:Tmath.
General definition
A real-valued function of Template:Math real variables is a function that takes as input Template:Math real numbers, commonly represented by the variables Template:Math, for producing another real number, the value of the function, commonly denoted Template:Math. For simplicity, in this article a real-valued function of several real variables will be simply called a function. To avoid any ambiguity, the other types of functions that may occur will be explicitly specified.
Some functions are defined for all real values of the variables (one says that they are everywhere defined), but some other functions are defined only if the value of the variable are taken in a subset Template:Math of Template:Math, the domain of the function, which is always supposed to contain an open subset of Template:Math. In other words, a real-valued function of Template:Math real variables is a function
such that its domain Template:Math is a subset of Template:Math that contains a nonempty open set.
An element of Template:Math being an Template:Math-tuple Template:Math (usually delimited by parentheses), the general notation for denoting functions would be Template:Math. The common usage, much older than the general definition of functions between sets, is to not use double parentheses and to simply write Template:Math.
It is also common to abbreviate the Template:Math-tuple Template:Math by using a notation similar to that for vectors, like boldface Template:Math, underline Template:Math, or overarrow Template:Math. This article will use bold.
A simple example of a function in two variables could be:
which is the volume Template:Math of a cone with base area Template:Math and height Template:Math measured perpendicularly from the base. The domain restricts all variables to be positive since lengths and areas must be positive.
For an example of a function in two variables:
where Template:Math and Template:Math are real non-zero constants. Using the three-dimensional Cartesian coordinate system, where the xy plane is the domain Template:Math and the z axis is the codomain Template:Math, one can visualize the image to be a two-dimensional plane, with a slope of Template:Math in the positive x direction and a slope of Template:Math in the positive y direction. The function is well-defined at all points Template:Math in Template:Math. The previous example can be extended easily to higher dimensions:
for Template:Math non-zero real constants Template:Math, which describes a Template:Math-dimensional hyperplane.
The Euclidean norm:
is also a function of n variables which is everywhere defined, while
is defined only for Template:Math.
For a non-linear example function in two variables:
which takes in all points in Template:Math, a disk of radius Template:Math "punctured" at the origin Template:Math in the plane Template:Math, and returns a point in Template:Math. The function does not include the origin Template:Math, if it did then Template:Math would be ill-defined at that point. Using a 3d Cartesian coordinate system with the xy-plane as the domain Template:Math, and the z axis the codomain Template:Math, the image can be visualized as a curved surface.
The function can be evaluated at the point Template:Math in Template:Math:
However, the function couldn't be evaluated at, say
since these values of Template:Math and Template:Math do not satisfy the domain's rule.
Image
The image of a function Template:Math is the set of all values of Template:Mvar when the Template:Math-tuple Template:Math runs in the whole domain of Template:Mvar. For a continuous (see below for a definition) real-valued function which has a connected domain, the image is either an interval or a single value. In the latter case, the function is a constant function.
The preimage of a given real number Template:Math is called a level set. It is the set of the solutions of the equation Template:Math.
Domain
The domain of a function of several real variables is a subset of Template:Math that is sometimes, but not always, explicitly defined. In fact, if one restricts the domain Template:Math of a function Template:Math to a subset Template:Math, one gets formally a different function, the restriction of Template:Math to Template:Math, which is denoted . In practice, it is often (but not always) not harmful to identify Template:Math and , and to omit the restrictor Template:Math.
Conversely, it is sometimes possible to enlarge naturally the domain of a given function, for example by continuity or by analytic continuation.
Moreover, many functions are defined in such a way that it is difficult to specify explicitly their domain. For example, given a function Template:Math, it may be difficult to specify the domain of the function If Template:Math is a multivariate polynomial, (which has as a domain), it is even difficult to test whether the domain of Template:Math is also . This is equivalent to test whether a polynomial is always positive, and is the object of an active research area (see Positive polynomial).
Algebraic structure
The usual operations of arithmetic on the reals may be extended to real-valued functions of several real variables in the following way:
- For every real number Template:Math, the constant function is everywhere defined.
- For every real number Template:Math and every function Template:Math, the function: has the same domain as Template:Math (or is everywhere defined if Template:Math).
- If Template:Math and Template:Math are two functions of respective domains Template:Math and Template:Math such that Template:Math contains a nonempty open subset of Template:Math, then and are functions that have a domain containing Template:Math.
It follows that the functions of Template:Math variables that are everywhere defined and the functions of Template:Math variables that are defined in some neighbourhood of a given point both form commutative algebras over the reals (Template:Math-algebras). This is a prototypical example of a function space.
One may similarly define
which is a function only if the set of the points Template:Math in the domain of Template:Math such that Template:Math contains an open subset of Template:Math. This constraint implies that the above two algebras are not fields.
Univariable functions associated with a multivariable function
One can easily obtain a function in one real variable by giving a constant value to all but one of the variables. For example, if Template:Math is a point of the interior of the domain of the function Template:Math, we can fix the values of Template:Math to Template:Math respectively, to get a univariable function
whose domain contains an interval centered at Template:Math. This function may also be viewed as the restriction of the function Template:Math to the line defined by the equations Template:Math for Template:Math.
Other univariable functions may be defined by restricting Template:Math to any line passing through Template:Math. These are the functions
where the Template:Math are real numbers that are not all zero.
In next section, we will show that, if the multivariable function is continuous, so are all these univariable functions, but the converse is not necessarily true.
Continuity and limit
Until the second part of 19th century, only continuous functions were considered by mathematicians. At that time, the notion of continuity was elaborated for the functions of one or several real variables a rather long time before the formal definition of a topological space and a continuous map between topological spaces. As continuous functions of several real variables are ubiquitous in mathematics, it is worth to define this notion without reference to the general notion of continuous maps between topological space.
For defining the continuity, it is useful to consider the distance function of Template:Math, which is an everywhere defined function of Template:Math real variables:
A function Template:Math is continuous at a point Template:Math which is interior to its domain, if, for every positive real number Template:Math, there is a positive real number Template:Math such that Template:Math for all Template:Math such that Template:Math. In other words, Template:Math may be chosen small enough for having the image by Template:Math of the ball of radius Template:Math centered at Template:Math contained in the interval of length Template:Math centered at Template:Math. A function is continuous if it is continuous at every point of its domain.
If a function is continuous at Template:Math, then all the univariate functions that are obtained by fixing all the variables Template:Math except one at the value Template:Math, are continuous at Template:Math. The converse is false; this means that all these univariate functions may be continuous for a function that is not continuous at Template:Math. For an example, consider the function Template:Math such that Template:Math, and is otherwise defined by
The functions Template:Math and Template:Math are both constant and equal to zero, and are therefore continuous. The function Template:Math is not continuous at Template:Math, because, if Template:Math and Template:Math, we have Template:Math, even if Template:Math is very small. Although not continuous, this function has the further property that all the univariate functions obtained by restricting it to a line passing through Template:Math are also continuous. In fact, we have
for Template:Math.
The limit at a point of a real-valued function of several real variables is defined as follows.[1] Let Template:Math be a point in topological closure of the domain Template:Math of the function Template:Math. The function, Template:Math has a limit Template:Math when Template:Math tends toward Template:Math, denoted
if the following condition is satisfied: For every positive real number Template:Math, there is a positive real number Template:Math such that
for all Template:Math in the domain such that
If the limit exists, it is unique. If Template:Math is in the interior of the domain, the limit exists if and only if the function is continuous at Template:Math. In this case, we have
When Template:Math is in the boundary of the domain of Template:Math, and if Template:Math has a limit at Template:Math, the latter formula allows to "extend by continuity" the domain of Template:Math to Template:Math.
Symmetry
A symmetric function is a function Template:Math that is unchanged when two variables Template:Math and Template:Math are interchanged:
where Template:Math and Template:Math are each one of Template:Math. For example:
is symmetric in Template:Math since interchanging any pair of Template:Math leaves Template:Math unchanged, but is not symmetric in all of Template:Math, since interchanging Template:Math with Template:Math or Template:Math or Template:Math gives a different function.
Function composition
Suppose the functions
or more compactly Template:Math, are all defined on a domain Template:Math. As the Template:Math-tuple Template:Math varies in Template:Math, a subset of Template:Math, the Template:Math-tuple Template:Math varies in another region Template:Math a subset of Template:Math. To restate this:
Then, a function Template:Math of the functions Template:Math defined on Template:Math,
is a function composition defined on Template:Math,[2] in other terms the mapping
Note the numbers Template:Math and Template:Math do not need to be equal.
For example, the function
defined everywhere on Template:Math can be rewritten by introducing
which is also everywhere defined in Template:Math to obtain
Function composition can be used to simplify functions, which is useful for carrying out multiple integrals and solving partial differential equations.
Calculus
Elementary calculus is the calculus of real-valued functions of one real variable, and the principal ideas of differentiation and integration of such functions can be extended to functions of more than one real variable; this extension is multivariable calculus.
Partial derivatives
Partial derivatives can be defined with respect to each variable:
Partial derivatives themselves are functions, each of which represents the rate of change of Template:Math parallel to one of the Template:Math axes at all points in the domain (if the derivatives exist and are continuous—see also below). A first derivative is positive if the function increases along the direction of the relevant axis, negative if it decreases, and zero if there is no increase or decrease. Evaluating a partial derivative at a particular point in the domain gives the rate of change of the function at that point in the direction parallel to a particular axis, a real number.
For real-valued functions of a real variable, Template:Math, its ordinary derivative Template:Math is geometrically the gradient of the tangent line to the curve Template:Math at all points in the domain. Partial derivatives extend this idea to tangent hyperplanes to a curve.
The second order partial derivatives can be calculated for every pair of variables:
Geometrically, they are related to the local curvature of the function's image at all points in the domain. At any point where the function is well-defined, the function could be increasing along some axes, and/or decreasing along other axes, and/or not increasing or decreasing at all along other axes.
This leads to a variety of possible stationary points: global or local maxima, global or local minima, and saddle points—the multidimensional analogue of inflection points for real functions of one real variable. The Hessian matrix is a matrix of all the second order partial derivatives, which are used to investigate the stationary points of the function, important for mathematical optimization.
In general, partial derivatives of higher order Template:Math have the form:
where Template:Math are each integers between Template:Math and Template:Math such that Template:Math, using the definitions of zeroth partial derivatives as identity operators:
The number of possible partial derivatives increases with Template:Math, although some mixed partial derivatives (those with respect to more than one variable) are superfluous, because of the symmetry of second order partial derivatives. This reduces the number of partial derivatives to calculate for some Template:Math.
Multivariable differentiability
A function Template:Math is differentiable in a neighborhood of a point Template:Math if there is an Template:Math-tuple of numbers dependent on Template:Math in general, Template:Math, so that:[3]
where as . This means that if Template:Math is differentiable at a point Template:Math, then Template:Math is continuous at Template:Math, although the converse is not true - continuity in the domain does not imply differentiability in the domain. If Template:Math is differentiable at Template:Math then the first order partial derivatives exist at Template:Math and:
for Template:Math, which can be found from the definitions of the individual partial derivatives, so the partial derivatives of Template:Math exist.
Assuming an Template:Math-dimensional analogue of a rectangular Cartesian coordinate system, these partial derivatives can be used to form a vectorial linear differential operator, called the gradient (also known as "nabla" or "del") in this coordinate system:
used extensively in vector calculus, because it is useful for constructing other differential operators and compactly formulating theorems in vector calculus.
Then substituting the gradient Template:Math (evaluated at Template:Math with a slight rearrangement gives:
where Template:Math denotes the dot product. This equation represents the best linear approximation of the function Template:Math at all points Template:Math within a neighborhood of Template:Math. For infinitesimal changes in Template:Math and Template:Math as Template:Math:
which is defined as the total differential, or simply differential, of Template:Math, at Template:Math. This expression corresponds to the total infinitesimal change of Template:Math, by adding all the infinitesimal changes of Template:Math in all the Template:Math directions. Also, Template:Math can be construed as a covector with basis vectors as the infinitesimals Template:Math in each direction and partial derivatives of Template:Math as the components.
Geometrically Template:Math is perpendicular to the level sets of Template:Math, given by Template:Math which for some constant Template:Math describes an Template:Math-dimensional hypersurface. The differential of a constant is zero:
in which Template:Math is an infinitesimal change in Template:Math in the hypersurface Template:Math, and since the dot product of Template:Math and Template:Math is zero, this means Template:Math is perpendicular to Template:Math.
In arbitrary curvilinear coordinate systems in Template:Math dimensions, the explicit expression for the gradient would not be so simple - there would be scale factors in terms of the metric tensor for that coordinate system. For the above case used throughout this article, the metric is just the Kronecker delta and the scale factors are all 1.
Differentiability classes
If all first order partial derivatives evaluated at a point Template:Math in the domain:
exist and are continuous for all Template:Math in the domain, Template:Math has differentiability class Template:Math. In general, if all order Template:Math partial derivatives evaluated at a point Template:Math:
exist and are continuous, where Template:Math, and Template:Math are as above, for all Template:Math in the domain, then Template:Math is differentiable to order Template:Math throughout the domain and has differentiability class Template:Math.
If Template:Math is of differentiability class Template:Math, Template:Math has continuous partial derivatives of all order and is called smooth. If Template:Math is an analytic function and equals its Taylor series about any point in the domain, the notation Template:Math denotes this differentiability class.
Multiple integration
Definite integration can be extended to multiple integration over the several real variables with the notation;
where each region Template:Math is a subset of or all of the real line:
and their Cartesian product gives the region to integrate over as a single set:
an Template:Math-dimensional hypervolume. When evaluated, a definite integral is a real number if the integral converges in the region Template:Math of integration (the result of a definite integral may diverge to infinity for a given region, in such cases the integral remains ill-defined). The variables are treated as "dummy" or "bound" variables which are substituted for numbers in the process of integration.
The integral of a real-valued function of a real variable Template:Math with respect to Template:Math has geometric interpretation as the area bounded by the curve Template:Math and the Template:Math-axis. Multiple integrals extend the dimensionality of this concept: assuming an Template:Math-dimensional analogue of a rectangular Cartesian coordinate system, the above definite integral has the geometric interpretation as the Template:Math-dimensional hypervolume bounded by Template:Math and the Template:Math axes, which may be positive, negative, or zero, depending on the function being integrated (if the integral is convergent).
While bounded hypervolume is a useful insight, the more important idea of definite integrals is that they represent total quantities within space. This has significance in applied mathematics and physics: if Template:Math is some scalar density field and Template:Math are the position vector coordinates, i.e. some scalar quantity per unit n-dimensional hypervolume, then integrating over the region Template:Math gives the total amount of quantity in Template:Math. The more formal notions of hypervolume is the subject of measure theory. Above we used the Lebesgue measure, see Lebesgue integration for more on this topic.
Theorems
With the definitions of multiple integration and partial derivatives, key theorems can be formulated, including the fundamental theorem of calculus in several real variables (namely Stokes' theorem), integration by parts in several real variables, the symmetry of higher partial derivatives and Taylor's theorem for multivariable functions. Evaluating a mixture of integrals and partial derivatives can be done by using theorem differentiation under the integral sign.
Vector calculus
One can collect a number of functions each of several real variables, say
into an Template:Math-tuple, or sometimes as a column vector or row vector, respectively:
all treated on the same footing as an Template:Math-component vector field, and use whichever form is convenient. All the above notations have a common compact notation Template:Math. The calculus of such vector fields is vector calculus. For more on the treatment of row vectors and column vectors of multivariable functions, see matrix calculus.
Implicit functions
A real-valued implicit function of several real variables is not written in the form "Template:Math". Instead, the mapping is from the space Template:Math to the zero element in Template:Math (just the ordinary zero 0):
is an equation in all the variables. Implicit functions are a more general way to represent functions, since if:
then we can always define:
but the converse is not always possible, i.e. not all implicit functions have an explicit form.
For example, using interval notation, let
Choosing a 3-dimensional (3D) Cartesian coordinate system, this function describes the surface of a 3D ellipsoid centered at the origin Template:Math with constant semi-major axes Template:Math, along the positive x, y and z axes respectively. In the case Template:Math, we have a sphere of radius Template:Math centered at the origin. Other conic section examples which can be described similarly include the hyperboloid and paraboloid, more generally so can any 2D surface in 3D Euclidean space. The above example can be solved for Template:Math, Template:Math or Template:Math; however it is much tidier to write it in an implicit form.
For a more sophisticated example:
for non-zero real constants Template:Math, this function is well-defined for all Template:Math, but it cannot be solved explicitly for these variables and written as "Template:Math", "Template:Math", etc.
The implicit function theorem of more than two real variables deals with the continuity and differentiability of the function, as follows.[4] Let Template:Math be a continuous function with continuous first order partial derivatives, and let ϕ evaluated at a point Template:Math be zero:
and let the first partial derivative of Template:Math with respect to Template:Math evaluated at Template:Math be non-zero:
Then, there is an interval Template:Math containing Template:Math, and a region Template:Math containing Template:Math, such that for every Template:Math in Template:Math there is exactly one value of Template:Math in Template:Math satisfying Template:Math, and Template:Math is a continuous function of Template:Math so that Template:Math. The total differentials of the functions are:
Substituting Template:Math into the latter differential and equating coefficients of the differentials gives the first order partial derivatives of Template:Math with respect to Template:Math in terms of the derivatives of the original function, each as a solution of the linear equation
for Template:Math.
Complex-valued function of several real variables
A complex-valued function of several real variables may be defined by relaxing, in the definition of the real-valued functions, the restriction of the codomain to the real numbers, and allowing complex values.
If Template:Math is such a complex valued function, it may be decomposed as
where Template:Math and Template:Math are real-valued functions. In other words, the study of the complex valued functions reduces easily to the study of the pairs of real valued functions.
This reduction works for the general properties. However, for an explicitly given function, such as:
the computation of the real and the imaginary part may be difficult.
Applications
Multivariable functions of real variables arise inevitably in engineering and physics, because observable physical quantities are real numbers (with associated units and dimensions), and any one physical quantity will generally depend on a number of other quantities.
Examples of real-valued functions of several real variables
Examples in continuum mechanics include the local mass density Template:Math of a mass distribution, a scalar field which depends on the spatial position coordinates (here Cartesian to exemplify), Template:Math, and time Template:Math:
Similarly for electric charge density for electrically charged objects, and numerous other scalar potential fields.
Another example is the velocity field, a vector field, which has components of velocity Template:Math that are each multivariable functions of spatial coordinates and time similarly:
Similarly for other physical vector fields such as electric fields and magnetic fields, and vector potential fields.
Another important example is the equation of state in thermodynamics, an equation relating pressure Template:Math, temperature Template:Math, and volume Template:Math of a fluid, in general it has an implicit form:
The simplest example is the ideal gas law:
where Template:Math is the number of moles, constant for a fixed amount of substance, and Template:Math the gas constant. Much more complicated equations of state have been empirically derived, but they all have the above implicit form.
Real-valued functions of several real variables appear pervasively in economics. In the underpinnings of consumer theory, utility is expressed as a function of the amounts of various goods consumed, each amount being an argument of the utility function. The result of maximizing utility is a set of demand functions, each expressing the amount demanded of a particular good as a function of the prices of the various goods and of income or wealth. In producer theory, a firm is usually assumed to maximize profit as a function of the quantities of various goods produced and of the quantities of various factors of production employed. The result of the optimization is a set of demand functions for the various factors of production and a set of supply functions for the various products; each of these functions has as its arguments the prices of the goods and of the factors of production.
Examples of complex-valued functions of several real variables
Some "physical quantities" may be actually complex valued - such as complex impedance, complex permittivity, complex permeability, and complex refractive index. These are also functions of real variables, such as frequency or time, as well as temperature.
In two-dimensional fluid mechanics, specifically in the theory of the potential flows used to describe fluid motion in 2d, the complex potential
is a complex valued function of the two spatial coordinates Template:Math and Template:Math, and other real variables associated with the system. The real part is the velocity potential and the imaginary part is the stream function.
The spherical harmonics occur in physics and engineering as the solution to Laplace's equation, as well as the eigenfunctions of the z-component angular momentum operator, which are complex-valued functions of real-valued spherical polar angles:
In quantum mechanics, the wavefunction is necessarily complex-valued, but is a function of real spatial coordinates (or momentum components), as well as time Template:Math:
where each is related by a Fourier transform.
See also
- Real coordinate space
- Real analysis
- Complex analysis
- Function of several complex variables
- Multivariate interpolation
- Scalar fields