Differential (mathematics)

Last updated

In mathematics, differential refers to several related notions [1] derived from the early days of calculus, put on a rigorous footing, such as infinitesimal differences and the derivatives of functions. [2]

Contents

The term is used in various branches of mathematics such as calculus, differential geometry, algebraic geometry and algebraic topology.

Introduction

The term differential is used nonrigorously in calculus to refer to an infinitesimal ("infinitely small") change in some varying quantity. For example, if x is a variable, then a change in the value of x is often denoted Δx (pronounced delta x). The differential dx represents an infinitely small change in the variable x. The idea of an infinitely small or infinitely slow change is, intuitively, extremely useful, and there are a number of ways to make the notion mathematically precise.

Using calculus, it is possible to relate the infinitely small changes of various variables to each other mathematically using derivatives. If y is a function of x, then the differential dy of y is related to dx by the formula where denotes not 'dy divided by dx' as one would intuitively read, but 'the derivative of y with respect to x '. This formula summarizes the idea that the derivative of y with respect to x is the limit of the ratio of differences Δyx as Δx approaches zero.

Basic notions

History and usage

Infinitesimal quantities played a significant role in the development of calculus. Archimedes used them, even though he did not believe that arguments involving infinitesimals were rigorous. [3] Isaac Newton referred to them as fluxions. However, it was Gottfried Leibniz who coined the term differentials for infinitesimal quantities and introduced the notation for them which is still used today.

In Leibniz's notation, if x is a variable quantity, then dx denotes an infinitesimal change in the variable x. Thus, if y is a function of x, then the derivative of y with respect to x is often denoted dy/dx, which would otherwise be denoted (in the notation of Newton or Lagrange) or y. The use of differentials in this form attracted much criticism, for instance in the famous pamphlet The Analyst by Bishop Berkeley. Nevertheless, the notation has remained popular because it suggests strongly the idea that the derivative of y at x is its instantaneous rate of change (the slope of the graph's tangent line), which may be obtained by taking the limit of the ratio Δyx as Δx becomes arbitrarily small. Differentials are also compatible with dimensional analysis, where a differential such as dx has the same dimensions as the variable x.

Calculus evolved into a distinct branch of mathematics during the 17th century CE, although there were antecedents going back to antiquity. The presentations of, e.g., Newton, Leibniz, were marked by non-rigorous definitions of terms like differential, fluent and "infinitely small". While many of the arguments in Bishop Berkeley's 1734 The Analyst are theological in nature, modern mathematicians acknowledge the validity of his argument against "the Ghosts of departed Quantities"; however, the modern approaches do not have the same technical issues. Despite the lack of rigor, immense progress was made in the 17th and 18th centuries. In the 19th century, Cauchy and others gradually developed the Epsilon, delta approach to continuity, limits and derivatives, giving a solid conceptual foundation for calculus.

In the 20th century, several new concepts in, e.g., multivariable calculus, differential geometry, seemed to encapsulate the intent of the old terms, especially differential; both differential and infinitesimal are used with new, more rigorous, meanings.

Differentials are also used in the notation for integrals because an integral can be regarded as an infinite sum of infinitesimal quantities: the area under a graph is obtained by subdividing the graph into infinitely thin strips and summing their areas. In an expression such as the integral sign (which is a modified long s) denotes the infinite sum, f(x) denotes the "height" of a thin strip, and the differential dx denotes its infinitely thin width.

Approaches

There are several approaches for making the notion of differentials mathematically precise.

  1. Differentials as linear maps. This approach underlies the definition of the derivative and the exterior derivative in differential geometry. [4]
  2. Differentials as nilpotent elements of commutative rings. This approach is popular in algebraic geometry. [5]
  3. Differentials in smooth models of set theory. This approach is known as synthetic differential geometry or smooth infinitesimal analysis and is closely related to the algebraic geometric approach, except that ideas from topos theory are used to hide the mechanisms by which nilpotent infinitesimals are introduced. [6]
  4. Differentials as infinitesimals in hyperreal number systems, which are extensions of the real numbers that contain invertible infinitesimals and infinitely large numbers. This is the approach of nonstandard analysis pioneered by Abraham Robinson. [7]

These approaches are very different from each other, but they have in common the idea of being quantitative, i.e., saying not just that a differential is infinitely small, but how small it is.

Differentials as linear maps

There is a simple way to make precise sense of differentials, first used on the Real line by regarding them as linear maps. It can be used on , , a Hilbert space, a Banach space, or more generally, a topological vector space. The case of the Real line is the easiest to explain. This type of differential is also known as a covariant vector or cotangent vector, depending on context.

Differentials as linear maps on R

Suppose is a real-valued function on . We can reinterpret the variable in as being a function rather than a number, namely the identity map on the real line, which takes a real number to itself: . Then is the composite of with , whose value at is . The differential (which of course depends on ) is then a function whose value at (usually denoted ) is not a number, but a linear map from to . Since a linear map from to is given by a matrix, it is essentially the same thing as a number, but the change in the point of view allows us to think of as an infinitesimal and compare it with the standard infinitesimal, which is again just the identity map from to (a matrix with entry ). The identity map has the property that if is very small, then is very small, which enables us to regard it as infinitesimal. The differential has the same property, because it is just a multiple of , and this multiple is the derivative by definition. We therefore obtain that , and hence . Thus we recover the idea that is the ratio of the differentials and .

This would just be a trick were it not for the fact that:

  1. it captures the idea of the derivative of at as the best linear approximation to at ;
  2. it has many generalizations.

Differentials as linear maps on Rn

If is a function from to , then we say that is differentiable [8] at if there is a linear map from to such that for any , there is a neighbourhood of such that for ,

We can now use the same trick as in the one-dimensional case and think of the expression as the composite of with the standard coordinates on (so that is the -th component of ). Then the differentials at a point form a basis for the vector space of linear maps from to and therefore, if is differentiable at , we can write as a linear combination of these basis elements:

The coefficients are (by definition) the partial derivatives of at with respect to . Hence, if is differentiable on all of , we can write, more concisely:

In the one-dimensional case this becomes as before.

This idea generalizes straightforwardly to functions from to . Furthermore, it has the decisive advantage over other definitions of the derivative that it is invariant under changes of coordinates. This means that the same idea can be used to define the differential of smooth maps between smooth manifolds.

Aside: Note that the existence of all the partial derivatives of at is a necessary condition for the existence of a differential at . However it is not a sufficient condition. For counterexamples, see Gateaux derivative.

Differentials as linear maps on a vector space

The same procedure works on a vector space with a enough additional structure to reasonably talk about continuity. The most concrete case is a Hilbert space, also known as a complete inner product space, where the inner product and its associated norm define a suitable concept of distance. The same procedure works for a Banach space, also known as a complete Normed vector space. However, for a more general topological vector space, some of the details are more abstract because there is no concept of distance.

For the important case of a finite dimension, any inner product space is a Hilbert space, any normed vector space is a Banach space and any topological vector space is complete. As a result, you can define a coordinate system from an arbitrary basis and use the same technique as for .

Differentials as germs of functions

This approach works on any differentiable manifold. If

  1. U and V are open sets containing p
  2. is continuous
  3. is continuous

then f is equivalent to g at p, denoted , if and only if there is an open containing p such that for every x in W. The germ of f at p, denoted , is the set of all real continuous functions equivalent to f at p; if f is smooth at p then is a smooth germ. If

  1. , and are open sets containing p
  2. , , and are smooth functions
  3. r is a real number

then

This shows that the germs at p form an algebra.

Define to be the set of all smooth germs vanishing at p and to be the product of ideals . Then a differential at p (cotangent vector at p) is an element of . The differential of a smooth function f at p, denoted , is .

A similar approach is to define differential equivalence of first order in terms of derivatives in an arbitrary coordinate patch. Then the differential of f at p is the set of all functions differentially equivalent to at p.

Algebraic geometry

In algebraic geometry, differentials and other infinitesimal notions are handled in a very explicit way by accepting that the coordinate ring or structure sheaf of a space may contain nilpotent elements. The simplest example is the ring of dual numbers R[ε], where ε2 = 0.

This can be motivated by the algebro-geometric point of view on the derivative of a function f from R to R at a point p. For this, note first that f f(p) belongs to the ideal Ip of functions on R which vanish at p. If the derivative f vanishes at p, then f f(p) belongs to the square Ip2 of this ideal. Hence the derivative of f at p may be captured by the equivalence class [f f(p)] in the quotient space Ip/Ip2, and the 1-jet of f (which encodes its value and its first derivative) is the equivalence class of f in the space of all functions modulo Ip2. Algebraic geometers regard this equivalence class as the restriction of f to a thickened version of the point p whose coordinate ring is not R (which is the quotient space of functions on R modulo Ip) but R[ε] which is the quotient space of functions on R modulo Ip2. Such a thickened point is a simple example of a scheme. [5]

Algebraic geometry notions

Differentials are also important in algebraic geometry, and there are several important notions.

Synthetic differential geometry

A fifth approach to infinitesimals is the method of synthetic differential geometry [9] or smooth infinitesimal analysis. [10] This is closely related to the algebraic-geometric approach, except that the infinitesimals are more implicit and intuitive. The main idea of this approach is to replace the category of sets with another category of smoothly varying sets which is a topos. In this category, one can define the real numbers, smooth functions, and so on, but the real numbers automatically contain nilpotent infinitesimals, so these do not need to be introduced by hand as in the algebraic geometric approach. However the logic in this new category is not identical to the familiar logic of the category of sets: in particular, the law of the excluded middle does not hold. This means that set-theoretic mathematical arguments only extend to smooth infinitesimal analysis if they are constructive (e.g., do not use proof by contradiction). Constuctivists regard this disadvantage as a positive thing, since it forces one to find constructive arguments wherever they are available.

Nonstandard analysis

The final approach to infinitesimals again involves extending the real numbers, but in a less drastic way. In the nonstandard analysis approach there are no nilpotent infinitesimals, only invertible ones, which may be viewed as the reciprocals of infinitely large numbers. [7] Such extensions of the real numbers may be constructed explicitly using equivalence classes of sequences of real numbers, so that, for example, the sequence (1, 1/2, 1/3, ..., 1/n, ...) represents an infinitesimal. The first-order logic of this new set of hyperreal numbers is the same as the logic for the usual real numbers, but the completeness axiom (which involves second-order logic) does not hold. Nevertheless, this suffices to develop an elementary and quite intuitive approach to calculus using infinitesimals, see transfer principle.

Differential geometry

The notion of a differential motivates several concepts in differential geometry (and differential topology).

Other meanings

The term differential has also been adopted in homological algebra and algebraic topology, because of the role the exterior derivative plays in de Rham cohomology: in a cochain complex the maps (or coboundary operators) di are often called differentials. Dually, the boundary operators in a chain complex are sometimes called codifferentials.

The properties of the differential also motivate the algebraic notions of a derivation and a differential algebra .

See also

Notes

    Citations

    1. "Differential". Wolfram MathWorld. Retrieved February 24, 2022. The word differential has several related meaning in mathematics. In the most common context, it means "related to derivatives." So, for example, the portion of calculus dealing with taking derivatives (i.e., differentiation), is known as differential calculus.
      The word "differential" also has a more technical meaning in the theory of differential k-forms as a so-called one-form.
    2. "differential - Definition of differential in US English by Oxford Dictionaries". Oxford Dictionaries - English. Archived from the original on January 3, 2014. Retrieved 13 April 2018.
    3. Boyer 1991.
    4. Darling 1994.
    5. 1 2 Eisenbud & Harris 1998.
    6. See Kock 2006 and Moerdijk & Reyes 1991.
    7. 1 2 See Robinson 1996 and Keisler 1986.
    8. See, for instance, Apostol 1967.
    9. See Kock 2006 and Lawvere 1968.
    10. See Moerdijk & Reyes 1991 and Bell 1998.

    Related Research Articles

    In mathematics, the derivative is a fundamental tool that quantifies the sensitivity of change of a function's output with respect to its input. The derivative of a function of a single variable at a chosen input value, when it exists, is the slope of the tangent line to the graph of the function at that point. The tangent line is the best linear approximation of the function near that input value. For this reason, the derivative is often described as the instantaneous rate of change, the ratio of the instantaneous change in the dependent variable to that of the independent variable. The process of finding a derivative is called differentiation.

    <span class="mw-page-title-main">Gradient</span> Multivariate derivative (mathematics)

    In vector calculus, the gradient of a scalar-valued differentiable function of several variables is the vector field whose value at a point gives the direction and the rate of fastest increase. The gradient transforms like a vector under change of basis of the space of variables of . If the gradient of a function is non-zero at a point , the direction of the gradient is the direction in which the function increases most quickly from , and the magnitude of the gradient is the rate of increase in that direction, the greatest absolute directional derivative. Further, a point where the gradient is the zero vector is known as a stationary point. The gradient thus plays a fundamental role in optimization theory, where it is used to minimize a function by gradient descent. In coordinate-free terms, the gradient of a function may be defined by:

    In mathematics, the tangent space of a manifold is a generalization of tangent lines to curves in two-dimensional space and tangent planes to surfaces in three-dimensional space in higher dimensions. In the context of physics the tangent space to a manifold at a point can be viewed as the space of possible velocities for a particle moving on the manifold.

    <span class="mw-page-title-main">Tangent</span> In mathematics, straight line touching a plane curve without crossing it

    In geometry, the tangent line (or simply tangent) to a plane curve at a given point is, intuitively, the straight line that "just touches" the curve at that point. Leibniz defined it as the line through a pair of infinitely close points on the curve. More precisely, a straight line is tangent to the curve y = f(x) at a point x = c if the line passes through the point (c, f(c)) on the curve and has slope f'(c), where f' is the derivative of f. A similar definition applies to space curves and curves in n-dimensional Euclidean space.

    <span class="mw-page-title-main">Hyperreal number</span> Element of a nonstandard model of the reals, which can be infinite or infinitesimal

    In mathematics, hyperreal numbers are an extension of the real numbers to include certain classes of infinite and infinitesimal numbers. A hyperreal number is said to be finite if, and only if, for some integer . is said to be infinitesimal if, and only if, for all positive integers . The term "hyper-real" was introduced by Edwin Hewitt in 1948.

    <span class="mw-page-title-main">Infinitesimal</span> Extremely small quantity in calculus; thing so small that there is no way to measure it

    In mathematics, an infinitesimal number is a non-zero quantity that is closer to 0 than any non-zero real number is. The word infinitesimal comes from a 17th-century Modern Latin coinage infinitesimus, which originally referred to the "infinity-eth" item in a sequence.

    On a differentiable manifold, the exterior derivative extends the concept of the differential of a function to differential forms of higher degree. The exterior derivative was first described in its current form by Élie Cartan in 1899. The resulting calculus, known as exterior calculus, allows for a natural, metric-independent generalization of Stokes' theorem, Gauss's theorem, and Green's theorem from vector calculus.

    In mathematics, differential forms provide a unified approach to define integrands over curves, surfaces, solids, and higher-dimensional manifolds. The modern notion of differential forms was pioneered by Élie Cartan. It has many applications, especially in geometry, topology and physics.

    In mathematics, especially differential geometry, the cotangent bundle of a smooth manifold is the vector bundle of all the cotangent spaces at every point in the manifold. It may be described also as the dual bundle to the tangent bundle. This may be generalized to categories with more structure than smooth manifolds, such as complex manifolds, or algebraic varieties or schemes. In the smooth case, any Riemannian metric or symplectic form gives an isomorphism between the cotangent bundle and the tangent bundle, but they are not in general isomorphic in other categories.

    <span class="mw-page-title-main">Differential operator</span> Typically linear operator defined in terms of differentiation of functions

    In mathematics, a differential operator is an operator defined as a function of the differentiation operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation that accepts a function and returns another function.

    In differential geometry, the Lie derivative, named after Sophus Lie by Władysław Ślebodziński, evaluates the change of a tensor field, along the flow defined by another vector field. This change is coordinate invariant and therefore the Lie derivative is defined on any differentiable manifold.

    In differential geometry, a one-form on a differentiable manifold is a differential form of degree one, that is, a smooth section of the cotangent bundle. Equivalently, a one-form on a manifold is a smooth mapping of the total space of the tangent bundle of to whose restriction to each fibre is a linear functional on the tangent space. Symbolically,

    In abstract algebra and multilinear algebra, a multilinear form on a vector space over a field is a map

    In mathematics, the total derivative of a function f at a point is the best linear approximation near this point of the function with respect to its arguments. Unlike partial derivatives, the total derivative approximates the function with respect to all of its arguments, not just a single one. In many situations, this is the same as considering all partial derivatives simultaneously. The term "total derivative" is primarily used when f is a function of several variables, because when f is a function of a single variable, the total derivative is the same as the ordinary derivative of the function.

    <span class="mw-page-title-main">Differentiable manifold</span> Manifold upon which it is possible to perform calculus

    In mathematics, a differentiable manifold is a type of manifold that is locally similar enough to a vector space to allow one to apply calculus. Any manifold can be described by a collection of charts (atlas). One may then apply ideas from calculus while working within the individual charts, since each chart lies within a vector space to which the usual rules of calculus apply. If the charts are suitably compatible, then computations done in one chart are valid in any other differentiable chart.

    In mathematics, the derivative is a fundamental construction of differential calculus and admits many possible generalizations within the fields of mathematical analysis, combinatorics, algebra, geometry, etc.

    In mathematics, geometric calculus extends geometric algebra to include differentiation and integration. The formalism is powerful and can be shown to reproduce other mathematical theories including vector calculus, differential geometry, and differential forms.

    In calculus, the differential represents the principal part of the change in a function with respect to changes in the independent variable. The differential is defined by where is the derivative of f with respect to , and is an additional real variable. The notation is such that the equation

    Most of the terms listed in Wikipedia glossaries are already defined and explained within Wikipedia itself. However, glossaries like this one are useful for looking up, comparing and reviewing large numbers of terms together. You can help enhance this page by adding new terms or writing definitions for existing ones.

    In mathematics, calculus on Euclidean space is a generalization of calculus of functions in one or several variables to calculus of functions on Euclidean space as well as a finite-dimensional real vector space. This calculus is also known as advanced calculus, especially in the United States. It is similar to multivariable calculus but is somewhat more sophisticated in that it uses linear algebra more extensively and covers some concepts from differential geometry such as differential forms and Stokes' formula in terms of differential forms. This extensive use of linear algebra also allows a natural generalization of multivariable calculus to calculus on Banach spaces or topological vector spaces.

    References