Operational calculus

Last updated March 03, 2024

Operational calculus, also known as operational analysis, is a technique by which problems in analysis, in particular differential equations, are transformed into algebraic problems, usually the problem of solving a polynomial equation.

History

The idea of representing the processes of calculus, differentiation and integration, as operators has a long history that goes back to Gottfried Wilhelm Leibniz. The mathematician Louis François Antoine Arbogast was one of the first to manipulate these symbols independently of the function to which they were applied.^[1]

This approach was further developed by Francois-Joseph Servois who developed convenient notations.^[2] Servois was followed by a school of British and Irish mathematicians including Charles James Hargreave, George Boole, Bownin, Carmichael, Doukin, Graves, Murphy, William Spottiswoode and Sylvester.

Treatises describing the application of operator methods to ordinary and partial differential equations were written by Robert Bell Carmichael in 1855^[3] and by Boole in 1859.^[4]

This technique was fully developed by the physicist Oliver Heaviside in 1893, in connection with his work in telegraphy.

Guided greatly by intuition and his wealth of knowledge on the physics behind his circuit studies, [Heaviside] developed the operational calculus now ascribed to his name.^[5]

At the time, Heaviside's methods were not rigorous, and his work was not further developed by mathematicians. Operational calculus first found applications in electrical engineering problems, for the calculation of transients in linear circuits after 1910, under the impulse of Ernst Julius Berg, John Renshaw Carson and Vannevar Bush.

A rigorous mathematical justification of Heaviside's operational methods came only after the work of Bromwich that related operational calculus with Laplace transformation methods (see the books by Jeffreys, by Carslaw or by MacLachlan for a detailed exposition). Other ways of justifying the operational methods of Heaviside were introduced in the mid-1920s using integral equation techniques (as done by Carson) or Fourier transformation (as done by Norbert Wiener).

A different approach to operational calculus was developed in the 1930s by Polish mathematician Jan Mikusiński, using algebraic reasoning.

Norbert Wiener laid the foundations for operator theory in his review of the existential status of the operational calculus in 1926:^[6]

The brilliant work of Heaviside is purely heuristic, devoid of even the pretense to mathematical rigor. Its operators apply to electric voltages and currents, which may be discontinuous and certainly need not be analytic. For example, the favorite corpus vile on which he tries out his operators is a function which vanishes to the left of the origin and is 1 to the right. This excludes any direct application of the methods of Pincherle…

Although Heaviside’s developments have not been justified by the present state of the purely mathematical theory of operators, there is a great deal of what we may call experimental evidence of their validity, and they are very valuable to the electrical engineers. There are cases, however, where they lead to ambiguous or contradictory results.

Principle

The key element of the operational calculus is to consider differentiation as an operator p = d/dt acting on functions. Linear differential equations can then be recast in the form of "functions" $F (p)$ of the operator p acting on the unknown function equaling the known function. Here, $F$ is defining something that takes in an operator p and returns another operator $F (p)$ . Solutions are then obtained by making the inverse operator of $F$ act on the known function. The operational calculus generally is typified by two symbols: the operator p, and the unit function 1. The operator in its use probably is more mathematical than physical, the unit function more physical than mathematical. The operator p in the Heaviside calculus initially is to represent the time differentiator d/dt. Further, it is desired for this operator to bear the reciprocal relation such that p⁻¹ denotes the operation of integration.^[5]

In electrical circuit theory, one is trying to determine the response of an electrical circuit to an impulse. Due to linearity, it is enough to consider a unit step:

Heaviside step function:

H (t)

such that H(t) = 0 if t < 0 and H(t) = 1 if t > 0.

The simplest example of application of the operational calculus is to solve: $p y = H (t)$ , which gives

y=\operatorname {p} ^{-1}H=\int _{0}^{t}H(u)\,du=t\,H(t).

From this example, one sees that $\operatorname {p} ^{-1}$ represents integration. Furthermore $n$ iterated integrations is represented by $\operatorname {p} ^{-n},$ so that

\operatorname {p} ^{-n}H(t)={\frac {t^{n}}{n!}}H(t).

Continuing to treat p as if it were a variable,

{\frac {\operatorname {p} }{\operatorname {p} -a}}H(t)={\frac {1}{1-{\frac {a}{\operatorname {p} }}}}\,H(t),

which can be rewritten by using a geometric series expansion:

{\frac {1}{1-{\frac {a}{\operatorname {p} }}}}H(t)=\sum _{n=0}^{\infty }a^{n}\operatorname {p} ^{-n}H(t)=\sum _{n=0}^{\infty }{\frac {a^{n}t^{n}}{n!}}H(t)=e^{at}H(t).

Using partial fraction decomposition, one can define any fraction in the operator p and compute its action on $H (t)$ . Moreover, if the function 1/F(p) has a series expansion of the form

{\frac {1}{F(\operatorname {p} )}}=\sum _{n=0}^{\infty }a_{n}\operatorname {p} ^{-n},

it is straightforward to find

{\frac {1}{F(\operatorname {p} )}}H(t)=\sum _{n=0}^{\infty }a_{n}{\frac {t^{n}}{n!}}H(t).

Applying this rule, solving any linear differential equation is reduced to a purely algebraic problem.

Heaviside went further and defined fractional power of p, thus establishing a connection between operational calculus and fractional calculus.

Using the Taylor expansion, one can also verify the Lagrange–Boole translation formula, $e a p f (t) = f (t + a)$ , so the operational calculus is also applicable to finite-difference equations and to electrical engineering problems with delayed signals.

Related Research Articles

The derivative is a fundamental tool of calculus that quantifies the sensitivity of change of a function's output with respect to its input. The derivative of a function of a single variable at a chosen input value, when it exists, is the slope of the tangent line to the graph of the function at that point. The tangent line is the best linear approximation of the function near that input value. For this reason, the derivative is often described as the instantaneous rate of change, the ratio of the instantaneous change in the dependent variable to that of the independent variable. The process of finding a derivative is called differentiation.

In mathematics, the Laplace transform, named after its discoverer Pierre-Simon Laplace, is an integral transform that converts a function of a real variable to a function of a complex variable $.$

In mathematics, an operator is generally a mapping or function that acts on elements of a space to produce elements of another space. There is no general definition of an operator, but the term is often used in place of function when the domain is a set of functions or other structured objects. Also, the domain of an operator is often difficult to characterize explicitly, and may be extended so as to act on related objects. See Operator (physics) for other examples.

<span class="mw-page-title-main">Oliver Heaviside</span> English electrical engineer, mathematician and physicist (1850–1925)

Oliver Heaviside FRS was an English self-taught mathematician and physicist who invented a new technique for solving differential equations, independently developed vector calculus, and rewrote Maxwell's equations in the form commonly used today. He significantly shaped the way Maxwell's equations are understood and applied in the decades following Maxwell's death. His formulation of the telegrapher's equations became commercially important during his own lifetime, after their significance went unremarked for a long while, as few others were versed at the time in his novel methodology. Although at odds with the scientific establishment for most of his life, Heaviside changed the face of telecommunications, mathematics, and science.

A finite difference is a mathematical expression of the form $f (x + b) - f (x + a)$ . If a finite difference is divided by $b - a$ , one gets a difference quotient. The approximation of derivatives by finite differences plays a central role in finite difference methods for the numerical solution of differential equations, especially boundary value problems.

<span class="mw-page-title-main">Fourier transform</span> Mathematical transform that expresses a function of time as a function of frequency

In physics, engineering and mathematics, the Fourier transform (FT) is an integral transform that converts a function into a form that describes the frequencies present in the original function. The output of the transform is a complex-valued function of frequency. The term Fourier transform refers to both this complex-valued function and the mathematical operation. When a distinction needs to be made the Fourier transform is sometimes called the frequency domain representation of the original function. The Fourier transform is analogous to decomposing the sound of a musical chord into the intensities of its constituent pitches.

The Heaviside step function, or the unit step function, usually denoted by $H$ or $θ$ , is a step function named after Oliver Heaviside, the value of which is zero for negative arguments and one for positive arguments. It is an example of the general class of step functions, all of which can be represented as linear combinations of translations of this one.

In mathematics, the Laplace operator or Laplacian is a differential operator given by the divergence of the gradient of a scalar function on Euclidean space. It is usually denoted by the symbols $, (where is the nabla operator), or . In a Cartesian coordinate system, the Laplacian is given by the sum of second partial derivatives of the function with respect to each independent variable. In other coordinate systems, such as cylindrical and spherical coordinates, the Laplacian also has a useful form. Informally, the Laplacian Δ f (p) of a function f at a point p measures by how much the average value of f over small spheres or balls centered at p deviates from f (p) .$

Fractional calculus is a branch of mathematical analysis that studies the several different possibilities of defining real number powers or complex number powers of the differentiation operator

In mathematics, a differential operator is an operator defined as a function of the differentiation operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation that accepts a function and returns another function.

In mathematics, a Green's function is the impulse response of an inhomogeneous linear differential operator defined on a domain with specified initial conditions or boundary conditions.

In mathematics, and in particular functional analysis, the shift operator, also known as the translation operator, is an operator that takes a function $x \mapsto f (x)$ to its translation $x \mapsto f (x + a)$ . In time series analysis, the shift operator is called the lag operator.

In mathematical analysis, asymptotic analysis, also known as asymptotics, is a method of describing limiting behavior.

In probability theory and related fields, Malliavin calculus is a set of mathematical techniques and ideas that extend the mathematical field of calculus of variations from deterministic functions to stochastic processes. In particular, it allows the computation of derivatives of random variables. Malliavin calculus is also called the stochastic calculus of variations. P. Malliavin first initiated the calculus on infinite dimensional space. Then, the significant contributors such as S. Kusuoka, D. Stroock, J-M. Bismut, Shinzo Watanabe, I. Shigekawa, and so on finally completed the foundations.

In physics and engineering, a phasor is a complex number representing a sinusoidal function whose amplitude, and initial phase are time-invariant and whose angular frequency is fixed. It is related to a more general concept called analytic representation, which decomposes a sinusoid into the product of a complex constant and a factor depending on time and frequency. The complex constant, which depends on amplitude and phase, is known as a phasor, or complex amplitude, and sinor or even complexor.

The rectangular function is defined as

A stochastic differential equation (SDE) is a differential equation in which one or more of the terms is a stochastic process, resulting in a solution which is also a stochastic process. SDEs have many applications throughout pure mathematics and are used to model various behaviours of stochastic models such as stock prices, random growth models or physical systems that are subjected to thermal fluctuations.

In differential calculus, there is no single uniform notation for differentiation. Instead, various notations for the derivative of a function or variable have been proposed by various mathematicians. The usefulness of each notation varies with the context, and it is sometimes advantageous to use more than one notation in a given context. The most common notations for differentiation are listed below.

In mathematics, Katugampola fractional operators are integral operators that generalize the Riemann–Liouville and the Hadamard fractional operators into a unique form. The Katugampola fractional integral generalizes both the Riemann–Liouville fractional integral and the Hadamard fractional integral into a single form and It is also closely related to the Erdelyi–Kober operator that generalizes the Riemann–Liouville fractional integral. Katugampola fractional derivative has been defined using the Katugampola fractional integral and as with any other fractional differential operator, it also extends the possibility of taking real number powers or complex number powers of the integral and differential operators.

In mathematics, the exponential response formula (ERF), also known as exponential response and complex replacement, is a method used to find a particular solution of a non-homogeneous linear ordinary differential equation of any order. The exponential response formula is applicable to non-homogeneous linear ordinary differential equations with constant coefficients if the function is polynomial, sinusoidal, exponential or the combination of the three. The general solution of a non-homogeneous linear ordinary differential equation is a superposition of the general solution of the associated homogeneous ODE and a particular solution to the non-homogeneous ODE. Alternative methods for solving ordinary differential equations of higher order are method of undetermined coefficients and method of variation of parameters.

References

↑ Louis Arbogast (1800) Du Calcul des Derivations, link from Google Books
↑ Francois-Joseph Servois (1814) Analise Transcendante. Essai sur un Nouveau Mode d'Exposition des Principes der Calcul Differential, Annales de Gergonne 5: 93–140
↑ Robert Bell Carmichael (1855) A treatise on the calculus of operations, Longman, link from Google Books
↑ George Boole (1859) A Treatise on Differential Equations, chapters 16 &17: Symbolical methods, link from HathiTrust
1 2 B. L. Robertson (1935) Operational Method of Circuit Analysis, Transactions of the American Institute of Electrical Engineers 54(10):1035–45, link from IEEE Explore
↑ Norbert Wiener (1926) The Operational Calculus, Mathematische Annalen 95:557 , link from Göttingen Digitalisierungszentrum

Further sources

During Heaviside's lifetime

Terquem & Gerono (1855). "[no title cited]". Nouvelles Annales de Mathématiques . 14: 83. — Some historical references on the precursor work up to Carmichael].

Heaviside, Oliver (1892). Electrical Papers. London, UK.{{cite book}}: CS1 maint: location missing publisher (link)

Heaviside, Oliver (1902) [1893, 1899]. Electromagnetic Theory. London, UK.{{cite book}}: CS1 maint: location missing publisher (link)

Heaviside, Oliver (1893). "III. On Operators in Physical Mathematics. Part I." Proceedings of the Royal Society of London . 52: 504–529. doi:10.1098/rspl.1892.0093. ISSN 0370-1662.

Heaviside, Oliver (1894). "VIII. On Operators in Physical Mathematics. Part II". Proceedings of the Royal Society of London. 54 (326–330): 105–143. doi:10.1098/rspl.1893.0059. ISSN 0370-1662. S2CID 121790063.

After Heaviside's death

Berg, E. (1929). Heaviside's Operational Calculus. McGraw-Hill – via Internet Archive (archive.org).

Bush, V. (1929). Operational Circuit Analysis. John Wiley & Sons. with an appendix by Norbert Wiener

Calvert, James B. (2002). "Heaviside, Laplace, and the inversion integral". mysite.du.edu (academic pers.). University of Denver.

Carslaw, H.S. (1941). Operational Methods in Applied Mathematics. Oxford University Press. Archived from the original on 19 July 2011 – via www.new.dli.ernet.in.

Carson, J.R. (January–February 1926). "The Heaviside operational calculus". Bulletin of the American Mathematical Society . 32 (1): 43–68. doi:10.1090/S0002-9904-1926-04162-8 . Retrieved 7 December 2023– via Project Euclid (projecteuclid.org).

Carson, J.R. (1926). Electric Circuit Theory and the Operational Calculus. McGraw Hill.

Churchill, R.V. (1958). Operational Mathematics. McGraw-Hill.

Davis, H.T. (1936). The Theory of Linear Operators. Bloomington, IL: Principia Press – via Internet Archive (archive.org).

Erdélyi, A. (2013) [1962]. Operational Calculus and Generalized Functions (reprint ed.). Dover. ISBN 978-0486497129.

Jeffreys, H. (1927). Operational Methods in Mathematical Physics. Cambridge University Press. Archived from the original on 2011-07-19 – via www.new.dli.ernet.in.

Jeffreys, H. (1927). Operational Methods in Mathematical Physics. Cambridge University Press – via Internet Archive (archive.org).

Lützen, J. (1979). "Heaviside's operational calculus and attempts to rigorize it". Archive for History of Exact Sciences . 21 (2): 161–200. doi:10.1007/BF00330405. S2CID 118606242.

Mc Lachlan, N.W. (1941). Modern Operational Calculus. MacMillan. Archived from the original on 19 July 2011 – via www.new.dli.ernet.in.

March, H.W. (May–June 1927). "The Heaviside operational calculus". Bulletin of the American Mathematical Society . 33 (3): 311–318. doi:10.1090/S0002-9904-1927-04363-4 – via Project Euclid (projecteuclid.org).

"A correction". Bulletin of the American Mathematical Society . 33 (4): 492. July–August 1927. doi:10.1090/S0002-9904-1927-04412-3 . Retrieved 7 December 2023– via Project Euclid (projecteuclid.org).

Mikusiński, J. (1960). Operational Calculus. Elsevier.

Nahin, P.J. (1985). "Oliver Heaviside: Fractional operators, and the age of the Earth". IEEE Transactions on Education . E-28 (2): 94–104. Bibcode:1985ITEdu..28...94N. doi:10.1109/TE.1985.4321749. S2CID 7161941 – via IEEE Explore.

Rota, G.C.; Kahaner, D.; Odlyzko, A. (1973). "On the foundations of combinatorial theory. VIII. Finite operator calculus". Journal of Mathematical Analysis and Applications . 42 (3): 684. doi: 10.1016/0022-247X(73)90172-8 .

van der Pol, B.; Bremmer, H. (1950). Operational Calculus. Cambridge University Press.

van der Pol, B. (1950). "Heaviside's operational calculus". Heaviside Centenary Volume. Institute of Electrical Engineers.

External links

IV Lindell HEAVISIDE OPERATIONAL RULES APPLICABLE TO ELECTROMAGNETIC PROBLEMS
Ron Doerfler Heaviside's Calculus
Jack Crenshaw essay showing use of operators More On the Rosetta Stone

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[1] Louis Arbogast (1800) Du Calcul des Derivations, link from Google Books

[2] Francois-Joseph Servois (1814) Analise Transcendante. Essai sur un Nouveau Mode d'Exposition des Principes der Calcul Differential, Annales de Gergonne 5: 93–140

[3] Robert Bell Carmichael (1855) A treatise on the calculus of operations, Longman, link from Google Books

[4] George Boole (1859) A Treatise on Differential Equations, chapters 16 &17: Symbolical methods, link from HathiTrust

[Rob35-5] 1 2 B. L. Robertson (1935) Operational Method of Circuit Analysis, Transactions of the American Institute of Electrical Engineers 54(10):1035–45, link from IEEE Explore

[6] Norbert Wiener (1926) The Operational Calculus, Mathematische Annalen 95:557 , link from Göttingen Digitalisierungszentrum

[1]

[2]

[3]

[4]

[5]

[6]