In stochastic analysis, a rough path is a generalization of the notion of smooth path allowing to construct a robust solution theory for controlled differential equations driven by classically irregular signals, for example a Wiener process. The theory was developed in the 1990s by Terry Lyons. [1] [2] [3] Several accounts of the theory are available. [4] [5] [6] [7]
Rough path theory is focused on capturing and making precise the interactions between highly oscillatory and non-linear systems. It builds upon the harmonic analysis of L.C. Young, the geometric algebra of K.T. Chen, the Lipschitz function theory of H. Whitney and core ideas of stochastic analysis. The concepts and the uniform estimates have widespread application in pure and applied Mathematics and beyond. It provides a toolbox to recover with relative ease many classical results in stochastic analysis (Wong-Zakai, Stroock-Varadhan support theorem, construction of stochastic flows, etc) without using specific probabilistic properties such as the martingale property or predictability. The theory also extends Itô's theory of SDEs far beyond the semimartingale setting. At the heart of the mathematics is the challenge of describing a smooth but potentially highly oscillatory and multidimensional path effectively so as to accurately predict its effect on a nonlinear dynamical system . The Signature is a homomorphism from the monoid of paths (under concatenation) into the grouplike elements of the free tensor algebra. It provides a graduated summary of the path . This noncommutative transform is faithful for paths up to appropriate null modifications. These graduated summaries or features of a path are at the heart of the definition of a rough path; locally they remove the need to look at the fine structure of the path. Taylor's theorem explains how any smooth function can, locally, be expressed as a linear combination of certain special functions (monomials based at that point). Coordinate iterated integrals (terms of the signature) form a more subtle algebra of features that can describe a stream or path in an analogous way; they allow a definition of rough path and form a natural linear "basis" for continuous functions on paths.
Martin Hairer used rough paths to construct a robust solution theory for the KPZ equation. [8] He then proposed a generalization known as the theory of regularity structures [9] for which he was awarded a Fields medal in 2014.
Rough path theory aims to make sense of the controlled differential equation
where the control, the continuous path taking values in a Banach space, need not be differentiable nor of bounded variation. A prevalent example of the controlled path is the sample path of a Wiener process. In this case, the aforementioned controlled differential equation can be interpreted as a stochastic differential equation and integration against "" can be defined in the sense of Itô. However, Itô's calculus is defined in the sense of and is in particular not a pathwise definition. Rough paths give an almost sure pathwise definition of stochastic differential equations. The rough path notion of solution is well-posed in the sense that if is a sequence of smooth paths converging to in the -variation metric (described below), and
then converges to in the -variation metric. This continuity property and the deterministic nature of solutions makes it possible to simplify and strengthen many results in Stochastic Analysis, such as the Freidlin-Wentzell's Large Deviation theory [10] as well as results about stochastic flows.
In fact, rough path theory can go far beyond the scope of Itô and Stratonovich calculus and allows to make sense of differential equations driven by non-semimartingale paths, such as Gaussian processes and Markov processes. [11]
Rough paths are paths taking values in the truncated free tensor algebra (more precisely: in the free nilpotent group embedded in the free tensor algebra), which this section now briefly recalls. The tensor powers of , denoted , are equipped with the projective norm (see Topological tensor product, note that rough path theory in fact works for a more general class of norms). Let be the truncated tensor algebra
Let be the simplex . Let . Let and be continuous maps . Let denote the projection of onto -tensors and likewise for . The -variation metric is defined as
where the supremum is taken over all finite partitions of .
A continuous function is a -geometric rough path if there exists a sequence of paths with finite total variation such that
converges in the -variation metric to as . [12]
A central result in rough path theory is Lyons' Universal Limit theorem. [1] One (weak) version of the result is the following: Let be a sequence of paths with finite total variation and let
Suppose that converges in the -variation metric to a -geometric rough path as . Let be functions that have at least bounded derivatives and the -th derivatives are -Hölder continuous for some . Let be the solution to the differential equation
and let be defined as
Then converges in the -variation metric to a -geometric rough path .
Moreover, is the solution to the differential equation
driven by the geometric rough path .
The theorem can be interpreted as saying that the solution map (aka the Itô-Lyons map) of the RDE is continuous (and in fact locally lipschitz) in the -variation topology. Hence rough paths theory demonstrates that by viewing driving signals as rough paths, one has a robust solution theory for classical stochastic differential equations and beyond.
Let be a multidimensional standard Brownian motion. Let denote the Stratonovich integration. Then
is a -geometric rough path for any . This geometric rough path is called the Stratonovich Brownian rough path.
More generally, let be a multidimensional fractional Brownian motion (a process whose coordinate components are independent fractional Brownian motions) with . If is the -th dyadic piecewise linear interpolation of , then
converges almost surely in the -variation metric to a -geometric rough path for . [13] This limiting geometric rough path can be used to make sense of differential equations driven by fractional Brownian motion with Hurst parameter . When , it turns out that the above limit along dyadic approximations does not converge in -variation. However, one can of course still make sense of differential equations provided one exhibits a rough path lift, existence of such a (non-unique) lift is a consequence of the Lyons–Victoir extension theorem.
In general, let be a -valued stochastic process. If one can construct, almost surely, functions so that
is a -geometric rough path, then is an enhancement of the process . Once an enhancement has been chosen, the machinery of rough path theory will allow one to make sense of the controlled differential equation
for sufficiently regular vector fields
Note that every stochastic process (even if it is a deterministic path) can have more than one (in fact, uncountably many) possible enhancements. [14] Different enhancements will give rise to different solutions to the controlled differential equations. In particular, it is possible to enhance Brownian motion to a geometric rough path in a way other than the Brownian rough path. [15] This implies that the Stratonovich calculus is not the only theory of stochastic calculus that satisfies the classical product rule
In fact any enhancement of Brownian motion as a geometric rough path will give rise a calculus that satisfies this classical product rule. Itô calculus does not come directly from enhancing Brownian motion as a geometric rough path, but rather as a branched rough path.
Rough path theory allows to give a pathwise notion of solution to (stochastic) differential equations of the form
provided that the multidimensional stochastic process can be almost surely enhanced as a rough path and that the drift and the volatility are sufficiently smooth (see the section on the Universal Limit Theorem).
There are many examples of Markov processes, Gaussian processes, and other processes that can be enhanced as rough paths. [16]
There are, in particular, many results on the solution to differential equation driven by fractional Brownian motion that have been proved using a combination of Malliavin calculus and rough path theory. In fact, it has been proved recently that the solution to controlled differential equation driven by a class of Gaussian processes, which includes fractional Brownian motion with Hurst parameter , has a smooth density under the Hörmander's condition on the vector fields. [17] [18]
Let denote the space of bounded linear maps from a Banach space to another Banach space .
Let be a -dimensional standard Brownian motion. Let and be twice-differentiable functions and whose second derivatives are -Hölder for some .
Let be the unique solution to the stochastic differential equation
where denotes Stratonovich integration.
The Freidlin Wentzell's large deviation theory aims to study the asymptotic behavior, as , of for closed or open sets with respect to the uniform topology.
The Universal Limit Theorem guarantees that the Itô map sending the control path to the solution is a continuous map from the -variation topology to the -variation topology (and hence the uniform topology). Therefore, the Contraction principle in large deviations theory reduces Freidlin–Wentzell's problem to demonstrating the large deviation principle for in the -variation topology. [10]
This strategy can be applied to not just differential equations driven by the Brownian motion but also to the differential equations driven any stochastic processes which can be enhanced as rough paths, such as fractional Brownian motion.
Once again, let be a -dimensional Brownian motion. Assume that the drift term and the volatility term has sufficient regularity so that the stochastic differential equation
has a unique solution in the sense of rough path. A basic question in the theory of stochastic flow is whether the flow map exists and satisfy the cocyclic property that for all ,
outside a null set independent of .
The Universal Limit Theorem once again reduces this problem to whether the Brownian rough path exists and satisfies the multiplicative property that for all ,
outside a null set independent of , and .
In fact, rough path theory gives the existence and uniqueness of not only outside a null set independent of , and but also of the drift and the volatility .
As in the case of Freidlin–Wentzell theory, this strategy holds not just for differential equations driven by the Brownian motion but to any stochastic processes that can be enhanced as rough paths.
Controlled rough paths, introduced by M. Gubinelli, [5] are paths for which the rough integral
can be defined for a given geometric rough path .
More precisely, let denote the space of bounded linear maps from a Banach space to another Banach space .
Given a -geometric rough path
on , a -controlled path is a function such that and that there exists such that for all and ,
and
Let be a -geometric rough path satisfying the Hölder condition that there exists , for all and all ,
where denotes the -th tensor component of . Let . Let be an -times differentiable function and the -th derivative is Hölder, then
is a -controlled path.
If is a -controlled path where , then
is defined and the path
is a -controlled path.
Let be functions that has at least derivatives and the -th derivatives are -Hölder continuous for some . Let be the solution to the differential equation
Define
where denotes the derivative operator, then
is a -controlled path.
Let be a continuous function with finite total variation. Define
The signature of a path is defined to be .
The signature can also be defined for geometric rough paths. Let be a geometric rough path and let be a sequence of paths with finite total variation such that
converges in the -variation metric to . Then
converges as for each . The signature of the geometric rough path can be defined as the limit of as .
The signature satisfies Chen's identity, [19] that
for all .
The set of paths whose signature is the trivial sequence, or more precisely,
can be completely characterized using the idea of tree-like path.
A -geometric rough path is tree-like if there exists a continuous function such that and for all and all ,
where denotes the -th tensor component of .
A geometric rough path satisfies if and only if is tree-like. [20] [21]
Given the signature of a path, it is possible to reconstruct the unique path that has no tree-like pieces. [22] [23]
It is also possible to extend the core results in rough path theory to infinite dimensions, providing that the norm on the tensor algebra satisfies certain admissibility condition. [24]
Independence is a fundamental notion in probability theory, as in statistics and the theory of stochastic processes. Two events are independent, statistically independent, or stochastically independent if, informally speaking, the occurrence of one does not affect the probability of occurrence of the other or, equivalently, does not affect the odds. Similarly, two random variables are independent if the realization of one does not affect the probability distribution of the other.
In mathematics, the tensor product of two vector spaces V and W is a vector space to which is associated a bilinear map that maps a pair to an element of denoted .
In mathematics, the floor function is the function that takes as input a real number x, and gives as output the greatest integer less than or equal to x, denoted ⌊x⌋ or floor(x). Similarly, the ceiling function maps x to the least integer greater than or equal to x, denoted ⌈x⌉ or ceil(x).
In probability theory and statistics, covariance is a measure of the joint variability of two random variables.
In statistical mechanics and information theory, the Fokker–Planck equation is a partial differential equation that describes the time evolution of the probability density function of the velocity of a particle under the influence of drag forces and random forces, as in Brownian motion. The equation can be generalized to other observables as well. The Fokker-Planck equation has multiple applications in information theory, graph theory, data science, finance, economics etc.
In mathematics, Itô's lemma or Itô's formula is an identity used in Itô calculus to find the differential of a time-dependent function of a stochastic process. It serves as the stochastic calculus counterpart of the chain rule. It can be heuristically derived by forming the Taylor series expansion of the function up to its second derivatives and retaining terms up to first order in the time increment and second order in the Wiener process increment. The lemma is widely employed in mathematical finance, and its best known application is in the derivation of the Black–Scholes equation for option values.
In vector calculus, Green's theorem relates a line integral around a simple closed curve C to a double integral over the plane region D bounded by C. It is the two-dimensional special case of Stokes' theorem. In one dimension, it is equivalent to the fundamental theorem of calculus. In three dimensions, it is equivalent to the divergence theorem.
In probability theory, a martingale is a sequence of random variables for which, at a particular time, the conditional expectation of the next value in the sequence is equal to the present value, regardless of all prior values.
In mathematics, the covariant derivative is a way of specifying a derivative along tangent vectors of a manifold. Alternatively, the covariant derivative is a way of introducing and working with a connection on a manifold by means of a differential operator, to be contrasted with the approach given by a principal connection on the frame bundle – see affine connection. In the special case of a manifold isometrically embedded into a higher-dimensional Euclidean space, the covariant derivative can be viewed as the orthogonal projection of the Euclidean directional derivative onto the manifold's tangent space. In this case the Euclidean derivative is broken into two parts, the extrinsic normal component and the intrinsic covariant derivative component.
In mathematics, tropical geometry is the study of polynomials and their geometric properties when addition is replaced with minimization and multiplication is replaced with ordinary addition:
A stochastic differential equation (SDE) is a differential equation in which one or more of the terms is a stochastic process, resulting in a solution which is also a stochastic process. SDEs have many applications throughout pure mathematics and are used to model various behaviours of stochastic models such as stock prices, random growth models or physical systems that are subjected to thermal fluctuations.
Itô calculus, named after Kiyosi Itô, extends the methods of calculus to stochastic processes such as Brownian motion. It has important applications in mathematical finance and stochastic differential equations.
In mathematics, Farkas' lemma is a solvability theorem for a finite system of linear inequalities. It was originally proven by the Hungarian mathematician Gyula Farkas. Farkas' lemma is the key result underpinning the linear programming duality and has played a central role in the development of mathematical optimization. It is used amongst other things in the proof of the Karush–Kuhn–Tucker theorem in nonlinear programming. Remarkably, in the area of the foundations of quantum theory, the lemma also underlies the complete set of Bell inequalities in the form of necessary and sufficient conditions for the existence of a local hidden-variable theory, given data from any specific set of measurements.
In mathematics, progressive measurability is a property in the theory of stochastic processes. A progressively measurable process, while defined quite technically, is important because it implies the stopped process is measurable. Being progressively measurable is a strictly stronger property than the notion of being an adapted process. Progressively measurable processes are important in the theory of Itô integrals.
In mathematics, the Skorokhod integral, also named Hitsuda–Skorokhod integral, often denoted , is an operator of great importance in the theory of stochastic processes. It is named after the Ukrainian mathematician Anatoliy Skorokhod and Japanese mathematician Masuyuki Hitsuda. Part of its importance is that it unifies several concepts:
In multilinear algebra, the tensor rank decomposition or rank-R decomposition is the decomposition of a tensor as a sum of R rank-1 tensors, where R is minimal. Computing this decomposition is an open problem.
The Brownian motion models for financial markets are based on the work of Robert C. Merton and Paul A. Samuelson, as extensions to the one-period market models of Harold Markowitz and William F. Sharpe, and are concerned with defining the concepts of financial assets and markets, portfolios, gains and wealth in terms of continuous-time stochastic processes.
In differential geometry, a fibered manifold is surjective submersion of smooth manifolds Y → X. Locally trivial fibered manifolds are fiber bundles. Therefore, a notion of connection on fibered manifolds provides a general framework of a connection on fiber bundles.
In numerical analysis, the local linearization (LL) method is a general strategy for designing numerical integrators for differential equations based on a local (piecewise) linearization of the given equation on consecutive time intervals. The numerical integrators are then iteratively defined as the solution of the resulting piecewise linear equation at the end of each consecutive interval. The LL method has been developed for a variety of equations such as the ordinary, delayed, random and stochastic differential equations. The LL integrators are key component in the implementation of inference methods for the estimation of unknown parameters and unobserved variables of differential equations given time series of observations. The LL schemes are ideals to deal with complex models in a variety of fields as neuroscience, finance, forestry management, control engineering, mathematical statistics, etc.
A Brownian snake is a stochastic Markov process on the space of stopped paths. It has been extensively studied., and was in particular successfully used as a representation of superprocesses.