PDE-constrained optimization

Last updated

PDE-constrained optimization is a subset of mathematical optimization where at least one of the constraints may be expressed as a partial differential equation. [1] Typical domains where these problems arise include aerodynamics, computational fluid dynamics, image segmentation, and inverse problems. [2] A standard formulation of PDE-constrained optimization encountered in a number of disciplines is given by: [3]

Contents

where is the control variable and is the squared Euclidean norm and is not a norm itself. Closed-form solutions are generally unavailable for PDE-constrained optimization problems, necessitating the development of numerical methods. [4] [5] [6]

Applications

Optimal control of bacterial chemotaxis system

The following example comes from p. 20-21 of Pearson. [3] Chemotaxis is the movement of an organism in response to an external chemical stimulus. One problem of particular interest is in managing the spatial dynamics of bacteria that are subject to chemotaxis to achieve some desired result. For a cell density and concentration density of a chemoattractant, it is possible to formulate a boundary control problem:

where is the ideal cell density, is the ideal concentration density, and is the control variable. This objective function is subject to the dynamics:

where is the Laplace operator.

See also

Related Research Articles

<span class="mw-page-title-main">Frobenius theorem (differential topology)</span> On finding a maximal set of solutions of a system of first-order homogeneous linear PDEs

In mathematics, Frobenius' theorem gives necessary and sufficient conditions for finding a maximal set of independent solutions of an overdetermined system of first-order homogeneous linear partial differential equations. In modern geometric terms, given a family of vector fields, the theorem gives necessary and sufficient integrability conditions for the existence of a foliation by maximal integral manifolds whose tangent bundles are spanned by the given vector fields. The theorem generalizes the existence theorem for ordinary differential equations, which guarantees that a single vector field always gives rise to integral curves; Frobenius gives compatibility conditions under which the integral curves of r vector fields mesh into coordinate grids on r-dimensional integral manifolds. The theorem is foundational in differential topology and calculus on manifolds.

In mathematics, the method of characteristics is a technique for solving partial differential equations. Typically, it applies to first-order equations, although more generally the method of characteristics is valid for any hyperbolic partial differential equation. The method is to reduce a partial differential equation to a family of ordinary differential equations along which the solution can be integrated from some initial data given on a suitable hypersurface.

In mathematics, a real-valued function defined on a connected open set is said to have a conjugate (function) if and only if they are respectively the real and imaginary parts of a holomorphic function of the complex variable That is, is conjugate to if is holomorphic on As a first consequence of the definition, they are both harmonic real-valued functions on . Moreover, the conjugate of if it exists, is unique up to an additive constant. Also, is conjugate to if and only if is conjugate to .

In mathematics, a hyperbolic partial differential equation of order is a partial differential equation (PDE) that, roughly speaking, has a well-posed initial value problem for the first derivatives. More precisely, the Cauchy problem can be locally solved for arbitrary initial data along any non-characteristic hypersurface. Many of the equations of mechanics are hyperbolic, and so the study of hyperbolic equations is of substantial contemporary interest. The model hyperbolic equation is the wave equation. In one spatial dimension, this is

In mathematics, the viscosity solution concept was introduced in the early 1980s by Pierre-Louis Lions and Michael G. Crandall as a generalization of the classical concept of what is meant by a 'solution' to a partial differential equation (PDE). It has been found that the viscosity solution is the natural solution concept to use in many applications of PDE's, including for example first order equations arising in dynamic programming, differential games or front evolution problems, as well as second-order equations such as the ones arising in stochastic optimal control or stochastic differential games.

In mathematics, Harnack's inequality is an inequality relating the values of a positive harmonic function at two points, introduced by A. Harnack (1887). Harnack's inequality is used to prove Harnack's theorem about the convergence of sequences of harmonic functions. J. Serrin (1955), and J. Moser generalized Harnack's inequality to solutions of elliptic or parabolic partial differential equations. Such results can be used to show the interior regularity of weak solutions.

In statistics, generalized least squares (GLS) is a method used to estimate the unknown parameters in a linear regression model. It is used when there is a non-zero amount of correlation between the residuals in the regression model. GLS is employed to improve statistical efficiency and reduce the risk of drawing erroneous inferences, as compared to conventional least squares and weighted least squares methods. It was first described by Alexander Aitken in 1935.

In conformal field theory and representation theory, a W-algebra is an associative algebra that generalizes the Virasoro algebra. W-algebras were introduced by Alexander Zamolodchikov, and the name "W-algebra" comes from the fact that Zamolodchikov used the letter W for one of the elements of one of his examples.

A parabolic partial differential equation is a type of partial differential equation (PDE). Parabolic PDEs are used to describe a wide variety of time-dependent phenomena, including heat conduction, particle diffusion, and pricing of derivative investment instruments.

The Omega ratio is a risk-return performance measure of an investment asset, portfolio, or strategy. It was devised by Con Keating and William F. Shadwick in 2002 and is defined as the probability weighted ratio of gains versus losses for some threshold return target. The ratio is an alternative for the widely used Sharpe ratio and is based on information the Sharpe ratio discards.

The narrow escape problem is a ubiquitous problem in biology, biophysics and cellular biology.

In mathematics, a free boundary problem is a partial differential equation to be solved for both an unknown function and an unknown domain . The segment of the boundary of which is not known at the outset of the problem is the free boundary.

In mathematics, Sobolev spaces for planar domains are one of the principal techniques used in the theory of partial differential equations for solving the Dirichlet and Neumann boundary value problems for the Laplacian in a bounded domain in the plane with smooth boundary. The methods use the theory of bounded operators on Hilbert space. They can be used to deduce regularity properties of solutions and to solve the corresponding eigenvalue problems.

<span class="mw-page-title-main">Symmetry in quantum mechanics</span> Properties underlying modern physics

Symmetries in quantum mechanics describe features of spacetime and particles which are unchanged under some transformation, in the context of quantum mechanics, relativistic quantum mechanics and quantum field theory, and with applications in the mathematical formulation of the standard model and condensed matter physics. In general, symmetry in physics, invariance, and conservation laws, are fundamentally important constraints for formulating physical theories and models. In practice, they are powerful methods for solving problems and predicting what can happen. While conservation laws do not always give the answer to the problem directly, they form the correct constraints and the first steps to solving a multitude of problems. In application, understanding symmetries can also provide insights on the eigenstates that can be expected. For example, the existence of degenerate states can be inferred by the presence of non commuting symmetry operators or that the non degenerate states are also eigenvectors of symmetry operators.

In mathematics, a multisymplectic integrator is a numerical method for the solution of a certain class of partial differential equations, that are said to be multisymplectic. Multisymplectic integrators are geometric integrators, meaning that they preserve the geometry of the problems; in particular, the numerical method preserves energy and momentum in some sense, similar to the partial differential equation itself. Examples of multisymplectic integrators include the Euler box scheme and the Preissman box scheme.

The Fokas method, or unified transform, is an algorithmic procedure for analysing boundary value problems for linear partial differential equations and for an important class of nonlinear PDEs belonging to the so-called integrable systems. It is named after Greek mathematician Athanassios S. Fokas.

The redundancy principle in biology expresses the need of many copies of the same entity to fulfill a biological function. Examples are numerous: disproportionate numbers of spermatozoa during fertilization compared to one egg, large number of neurotransmitters released during neuronal communication compared to the number of receptors, large numbers of released calcium ions during transient in cells, and many more in molecular and cellular transduction or gene activation and cell signaling. This redundancy is particularly relevant when the sites of activation are physically separated from the initial position of the molecular messengers. The redundancy is often generated for the purpose of resolving the time constraint of fast-activating pathways. It can be expressed in terms of the theory of extreme statistics to determine its laws and quantify how the shortest paths are selected. The main goal is to estimate these large numbers from physical principles and mathematical derivations.

Tau functions are an important ingredient in the modern mathematical theory of integrable systems, and have numerous applications in a variety of other domains. They were originally introduced by Ryogo Hirota in his direct method approach to soliton equations, based on expressing them in an equivalent bilinear form.

<span class="mw-page-title-main">Physics-informed neural networks</span> Technique to solve partial differential equations

Physics-informed neural networks (PINNs) are a type of universal function approximators that can embed the knowledge of any physical laws that govern a given data-set in the learning process, and can be described by partial differential equations (PDEs). They overcome the low data availability of some biological and engineering systems that makes most state-of-the-art machine learning techniques lack robustness, rendering them ineffective in these scenarios. The prior knowledge of general physical laws acts in the training of neural networks (NNs) as a regularization agent that limits the space of admissible solutions, increasing the correctness of the function approximation. This way, embedding this prior information into a neural network results in enhancing the information content of the available data, facilitating the learning algorithm to capture the right solution and to generalize well even with a low amount of training examples.

In cosmology, Gurzadyan theorem, proved by Vahe Gurzadyan, states the most general functional form for the force satisfying the condition of identity of the gravity of the sphere and of a point mass located in the sphere's center. This theorem thus refers to the first statement of Isaac Newton’s shell theorem but not the second one, namely, the absence of gravitational force inside a shell.

References

  1. Leugering, Günter; Benner, Peter; Engell, Sebastian; Griewank, Andreas; Harbrecht, Helmut; Hinze, Michael; Rannacher, Rolf; Ulbrich, Stefan, eds. (2014). "Trends in PDE Constrained Optimization". International Series of Numerical Mathematics. Springer. 165. doi:10.1007/978-3-319-05083-6. ISBN   978-3-319-05082-9. ISSN   0373-3149.
  2. Lorenz T. Biegler; Omar Ghattas; Matthias Heinkenschloss; David Keyes; Bart van Bloemen Waanders, eds. (2007-01-01). Real-Time PDE-Constrained Optimization. Computational Science & Engineering. Society for Industrial and Applied Mathematics. doi:10.1137/1.9780898718935. ISBN   978-0-89871-621-4.
  3. 1 2 Pearson, John (May 16, 2018). "PDE-Constrained Optimization in Physics, Chemistry & Biology: Modelling and Numerical Methods" (PDF). University of Edinburgh.
  4. Biros, George; Ghattas, Omar (2005-01-01). "Parallel Lagrange--Newton--Krylov--Schur Methods for PDE-Constrained Optimization. Part I: The Krylov--Schur Solver". SIAM Journal on Scientific Computing. 27 (2): 687–713. Bibcode:2005SJSC...27..687B. doi:10.1137/S106482750241565X. ISSN   1064-8275.
  5. Antil, Harbir; Heinkenschloss, Matthias; Hoppe, Ronald H. W.; Sorensen, Danny C. (2010-08-01). "Domain decomposition and model reduction for the numerical solution of PDE constrained optimization problems with localized optimization variables". Computing and Visualization in Science. 13 (6): 249–264. doi:10.1007/s00791-010-0142-4. ISSN   1433-0369. S2CID   9412768.
  6. Schöberl, Joachim; Zulehner, Walter (2007-01-01). "Symmetric Indefinite Preconditioners for Saddle Point Problems with Applications to PDE-Constrained Optimization Problems". SIAM Journal on Matrix Analysis and Applications. 29 (3): 752–773. doi:10.1137/060660977. ISSN   0895-4798.
  7. Jameson, Antony (2003). "Aerodynamic Shape Optimization Using the Adjoint Method" (PDF). Stanford University.
  8. Hazra, S. B.; Schulz, V.; Brezillon, J.; Gauger, N. R. (2005-03-20). "Aerodynamic shape optimization using simultaneous pseudo-timestepping". Journal of Computational Physics. 204 (1): 46–64. Bibcode:2005JCoPh.204...46H. doi:10.1016/j.jcp.2004.10.007. ISSN   0021-9991.
  9. Somayaji, Mahadevabharath R.; Xenos, Michalis; Zhang, Libin; Mekarski, Megan; Linninger, Andreas A. (2008-01-01). "Systematic design of drug delivery therapies". Computers & Chemical Engineering. Process Systems Engineering: Contributions on the State-of-the-Art. 32 (1): 89–98. doi:10.1016/j.compchemeng.2007.06.014. ISSN   0098-1354.
  10. Antil, Harbir; Nochetto, Ricardo H.; Venegas, Pablo (2017-10-19). "Optimizing the Kelvin force in a moving target subdomain". Mathematical Models and Methods in Applied Sciences. 28 (1): 95–130. arXiv: 1612.07763 . doi:10.1142/S0218202518500033. ISSN   0218-2025. S2CID   119604277.
  11. Egger, Herbert; Engl, Heinz W. (2005). "Tikhonov regularization applied to the inverse problem of option pricing: convergence analysis and rates". Inverse Problems. 21 (3): 1027–1045. Bibcode:2005InvPr..21.1027E. doi:10.1088/0266-5611/21/3/014. S2CID   11012681.
  12. Mehdaoui, Mohamed; Lacitignola, Deborah; Tilioua, Mouhcine (2024). "Optimal social distancing through cross-diffusion control for a disease outbreak PDE model". Communications in Nonlinear Science and Numerical Simulation. 131: 107855. ISSN   1007-5704.

Further reading