Cybernetical physics

Last updated

Cybernetical physics is a scientific area on the border of cybernetics and physics which studies physical systems with cybernetical methods. Cybernetical methods are understood as methods developed within control theory, information theory, systems theory and related areas: control design, estimation, identification, optimization, pattern recognition, signal processing, image processing, etc. Physical systems are also understood in a broad sense; they may be either lifeless, living nature or of artificial (engineering) origin, and must have reasonably understood dynamics and models suitable for posing cybernetical problems. Research objectives in cybernetical physics are frequently formulated as analyses of a class of possible system state changes under external (controlling) actions of a certain class. An auxiliary goal is designing the controlling actions required to achieve a prespecified property change. Among typical control action classes are functions which are constant in time (bifurcation analysis, optimization), functions which depend only on time (vibration mechanics, spectroscopic studies, program control), and functions whose value depends on measurement made at the same time or on previous instances. The last class is of special interest since these functions correspond to system analysis by means of external feedback (feedback control).

Contents

Roots of cybernetical physics

Until recently no creative interaction of physics and control theory (cybernetics) had been seen and no control theory methods were directly used for discovering new physical effects and phenomena. The situation dramatically changed in the 1990s when two new areas emerged: control of chaos and quantum control.

Control of chaos

In 1990 a paper [1] was published in Physical Review Letters by Edward Ott, Celso Grebogi and James Yorke from the University of Maryland reporting that even small feedback action can dramatically change the behavior of a nonlinear system, e.g., turn chaotic motions into periodic ones and vice versa. The idea almost immediately became popular in the physics community, and since 1990 hundreds of papers have been published demonstrating the ability of small control, with or without feedback, to significantly change the dynamics of real or model systems. By 2003, this paper by Ott, Grebogi and Yorke [1] had been quoted over 1300 times whilst the total number of papers relating to control of chaos exceeded 4000 by the beginning of the 21st century, with 300-400 papers per year being published in peer reviewed journals. The method proposed in [1] is now called the OGY-method after the authors' initials.

Later, a number of other methods were proposed for transforming chaotic trajectories into periodic ones, for example delayed feedback (Pyragas method). [2] Numerous nonlinear and adaptive control methods were also applied for the control of chaos, see surveys in. [3] [4] [5] [6]

It is important that the results obtained were interpreted as discovering new properties of physical systems. Thousands of papers were published that examine and predict properties of systems based on the use of control, identification and other cybernetic methods. Notably, most of those papers were published in physical journals, their authors representing university physics departments. It has become clear that such types of control goals are important not only for the control of chaos, but also for the control of a broader class of oscillatory processes. This provides evidence for the existence of an emerging field of research related to both physics and control, that of "cybernetical physics". [7] [8]

Quantum control

It is conceivable that molecular physics was the area where ideas of control first appeared. James Clerk Maxwell introduced a hypothetical being, known as Maxwell's Demon, with the ability to measure the velocities of gas molecules in a vessel and to direct the fast molecules to one part of the vessel while keeping the slow molecules in another part. This produces a temperature difference between the two parts of the vessel, which seems to contradict the Second Law of Thermodynamics. Now, after more than a century of fruitful life, this demon is even more active than in the past. Recent papers discussed issues relating to the experimental implementation of Maxwell's Demon, particularly at the quantum-mechanical level. [9]

At the end of the 1970s the first mathematical results for the control of quantum mechanical models appeared based on control theory [10] At the end of the 1980s and beginning of the 1990s rapid developments in the laser industry led to the appearance of ultrafast, so-called femtosecond lasers. This new generation of lasers has the ability to generate pulses with durations of a few femtoseconds and even less (1 fs = sec). The duration of such a pulse is comparable with the period of a molecule's natural oscillation. Therefore, a femtosecond laser can, in principle, be used as a mean of controlling single molecules and atoms. A consequence of such an application is the possibility of realizing the alchemists' dream of changing the natural course of chemical reactions. A new area in chemistry emerged, femtochemistry, and new femtotechnologies were developed. Ahmed Zewail from Caltech was awarded the 1999 Nobel Prize in Chemistry for his work on femtochemistry.

Using modern control theory, new horizons may open for studying the interaction of atoms and molecules, and new ways and possible limits may be discovered for intervening in the intimate processes of the microworld. Besides, control is an important part of many recent nanoscale applications, including nanomotors, nanowires, nanochips, nanorobots, etc. The number of publications in peer reviewed journals exceeds 600 per year.

Control thermodynamics

The basics of thermodynamics were stated by Sadi Carnot in 1824. He considered a heat engine which operates by drawing heat from a source which is at thermal equilibrium at temperature , and delivering useful work. Carnot saw that, in order to operate continuously, the engine requires also a cold reservoir with the temperature , to which some heat can be discharged. By simple logic he established the famous ‘’’Carnot Principle’’’: ‘’No heat engine can be more efficient than a reversible one operating between the same temperatures’’.

In fact it was nothing but the solution to an optimal control problem: maximum work can be extracted by a reversible machine and the value of extracted work depends only on the temperatures of the source and the bath. Later, Kelvin introduced his absolute temperature scale (Kelvin scale) and accomplished the next step, evaluating Carnot's reversible efficiency However, most work was devoted to studying stationary systems over infinite time intervals, while for practical purposes it is important to know the possibilities and limitations of the system's evolution for finite times as well as under other types of constraints caused by a finite amount of available resources.

The pioneer work devoted to evaluating finite time limitations for heat engines was published by I. Novikov in 1957, [11] and independently by F.L. Curzon and B. Ahlborn in 1975: [12] the efficiency at maximum power per cycle of a heat engine coupled to its surroundings through a constant heat conductor is (the Novikov-Curzon-Ahlborn formula). The Novikov-Curzon-Ahlborn process is also optimal in the sense of minimal dissipation. Otherwise, if the dissipation degree is given, the process corresponds to the maximum entropy principle. Later, the results [12] [11] were extended and generalized for other criteria and for more complex situations based on modern optimal control theory. As a result, a new direction in thermodynamics arose known under the names "optimization thermodynamics", "finite-time thermodynamics", Endoreversible thermodynamics or "control thermodynamics", see. [13]

Subject and methodology of cybernetical physics

By the end of the 1990s it had become clear that a new area in physics dealing with control methods had emerged. The term "cybernetical physics" was proposed in. [7] [14] The subject and methodology of the field are systematically presented in. [15] [16]

A description of the control problems related to cybernetical physics includes classes of controlled plant models, control objectives (goals) and admissible control algorithms. The methodology of cybernetical physics comprises typical methods used for solving problems and typical results in the field.

Models of controlled systems

A formal statement of any control problem begins with a model of the system to be controlled (plant) and a model of the control objective (goal). Even if the plant model is not given (the case in many real world applications) it should be determined in some way. The system models used in cybernetics are similar to traditional models of physics and mechanics with one difference: the inputs and outputs of the model should be explicitly specified. The following main classes of models are considered in the literature related to control of physical systems: continuous systems with lumped parameters described in state space by differential equations, distributed (spatio-temporal) systems described by partial differential equations, and discrete-time state-space models described by difference equations.

Control goals

It is natural to classify control problems by their control goals. Five kinds are listed below.

Regulation (often called stabilization or positioning) is the most common and simple control goal. Regulation is understood as driving the state vector (or the output vector ) to some equilibrium state (respectively, ).

Tracking. State tracking is driving a solution to the prespecified function of time . Similarly, output tracking is driving the output to the desired output function . The problem is more complex if the desired equilibrium or trajectory is unstable in the absence of control action. For example, a typical problem of chaos control can be formulated as tracking an unstable periodic solution (orbit). The key feature of the control problems for physical systems is that the goal should be achieved by means of sufficiently small control. A limit case is stabilization of a system by an arbitrarily small control. The solvability of this task is not obvious if the trajectory is unstable, for example in the case of chaotic systems. See. [1]

Generation (excitation) of oscillations. The third class of control goals corresponds to the problems of "excitation" or "generation" of oscillations. Here, it is assumed that the system is initially at rest. The problem is to find out if it is possible to drive it into an oscillatory mode with the desired characteristics (energy, frequency, etc.) In this case the goal trajectory of the state vector is not prespecified. Moreover, the goal trajectory may be unknown, or may even be irrelevant to the achievement of the control goal. Such problems are well known in electrical, radio engineering, acoustics, laser, and vibrational technologies, and indeed wherever it is necessary to create an oscillatory mode for a system. Such a class of control goals can be related to problems of dissociation, ionization of molecular systems, escape from a potential well, chaotization, and other problems related to the growth of the system energy and its possible phase transition. Sometimes such problems can be reduced to tracking, but the reference trajectories in these cases are not necessarily periodic and may be unstable. Besides, the goal trajectory may be known only partially.

Synchronization. The fourth important class of control goals corresponds to synchronization (more accurately, "controlled synchronization" as distinct from "autosynchronization" or "self-synchronization"). Generally speaking, synchronization is understood as concurrent change of the states of two or more systems or, perhaps, concurrent change of some quantities related to the systems, e.g., equalizing of oscillation frequencies. If the required relation is established only asymptotically, one speaks of "asymptotic synchronization". If synchronization does not exist in the system without control the problem may be posed as finding the control function which ensures synchronization in the closed-loop system, i.e., synchronization may be a control goal. Synchronization problem differs from the model reference control problem in that some phase shifts between the processes are allowed that are either constant or tend to constant values. Besides, in a number of synchronization problems the links between the systems to be synchronized are bidirectional. In such cases the limit mode (synchronous mode) in the overall system is not known in advance.

Modification of the limit sets (attractors) of the systems. The last class of control goals is related to the modification of some quantitative characteristics that limit the behavior of the system. It includes such specific goals as

Investigation of the above problems started at the end of the 1980s with work on bifurcation control and continued with work on the control of chaos. Ott, Grebogi and Yorke [1] and their followers introduced a new class of control goals not requiring any quantitative characteristic of the desired motion. Instead, the desired qualitative type of the limit set (attractor) was specified, e.g., control should provide the system with a chaotic attractor. Additionally, the desired degree of chaoticity may be specified by specifying the Lyapunov exponent, fractal dimension, entropy, etc. See. [4] [5]

In addition to the main control goal, some additional goals or constraints may be specified. A typical example is the "small control" requirement: the control function should have little power or should require a small expenditure of energy. Such a restriction is needed to avoid "violence" and preserve the inherent properties of the system under control. This is important for ensuring the elimination of artefacts and for an adequate study of the system. Three types of control are used in physical problems: constant control, feedforward control and feedback control. Implementation of a feedback control requires additional measurement devices working in real time, which are often hard to install. Therefore, studying the system may start with the application of inferior forms of control: time-constant and then feedforward control. The possibilities of changing system behavior by means of feedback control can then be studied.

Methodology

The methodology of cybernetical physics is based on control theory. Typically, some parameters of physical systems are unknown and some variables are not available for measurement. From the control viewpoint this means that control design should be performed under significant uncertainty, i.e., methods of robust control or adaptive control should be used. A variety of design methods have been developed by control theorists and control engineers for both linear and nonlinear systems. Methods of partial control, control by weak signals, etc. have also been developed.

Fields of research and prospects

Currently, an interest in applying control methods in physics is still growing. The following areas of research are being actively developed: [15] [16]

Among the most important applications are: control of fusion, control of beams, control in nano- and femto-technologies.

In order to facilitate information exchange in the area of cybernetical physics the International Physics and Control Society (IPACS) was created. IPACS organizes regular conferences (Physics and Control Conferences) and supports an electronic library, IPACS Electronic Library and an information portal, Physics and Control Resources.

See also

Related Research Articles

<span class="mw-page-title-main">Butterfly effect</span> Idea that small causes can have large effects

In chaos theory, the butterfly effect is the sensitive dependence on initial conditions in which a small change in one state of a deterministic nonlinear system can result in large differences in a later state.

<span class="mw-page-title-main">Chaos theory</span> Field of mathematics

Chaos theory is an interdisciplinary area of scientific study and branch of mathematics focused on underlying patterns and deterministic laws of dynamical systems that are highly sensitive to initial conditions, and were once thought to have completely random states of disorder and irregularities. Chaos theory states that within the apparent randomness of chaotic complex systems, there are underlying patterns, interconnection, constant feedback loops, repetition, self-similarity, fractals, and self-organization. The butterfly effect, an underlying principle of chaos, describes how a small change in one state of a deterministic nonlinear system can result in large differences in a later state. A metaphor for this behavior is that a butterfly flapping its wings in Brazil can cause a tornado in Texas.

<span class="mw-page-title-main">Dynamical system</span> Mathematical model of the time dependence of a point in space

In mathematics, a dynamical system is a system in which a function describes the time dependence of a point in an ambient space. Examples include the mathematical models that describe the swinging of a clock pendulum, the flow of water in a pipe, the random motion of particles in the air, and the number of fish each springtime in a lake. The most general definition unifies several concepts in mathematics such as ordinary differential equations and ergodic theory by allowing different choices of the space and how time is measured. Time can be measured by integers, by real or complex numbers or can be a more general algebraic object, losing the memory of its physical origin, and the space may be a manifold or simply a set, without the need of a smooth space-time structure defined on it.

Statistical physics is a branch of physics that evolved from a foundation of statistical mechanics, which uses methods of probability theory and statistics, and particularly the mathematical tools for dealing with large populations and approximations, in solving physical problems. It can describe a wide variety of fields with an inherently stochastic nature. Its applications include many problems in the fields of physics, biology, chemistry, and neuroscience. Its main purpose is to clarify the properties of matter in aggregate, in terms of physical laws governing atomic motion.

<span class="mw-page-title-main">Computational physics</span> Numerical simulations of physical problems via computers

Computational physics is the study and implementation of numerical analysis to solve problems in physics for which a quantitative theory already exists. Historically, computational physics was the first application of modern computers in science, and is now a subset of computational science. It is sometimes regarded as a subdiscipline of theoretical physics, but others consider it an intermediate branch between theoretical and experimental physics - an area of study which supplements both theory and experiment.

In mathematics and science, a nonlinear system is a system in which the change of the output is not proportional to the change of the input. Nonlinear problems are of interest to engineers, biologists, physicists, mathematicians, and many other scientists because most systems are inherently nonlinear in nature. Nonlinear dynamical systems, describing changes in variables over time, may appear chaotic, unpredictable, or counterintuitive, contrasting with much simpler linear systems.

<span class="mw-page-title-main">Lyapunov exponent</span> The rate of separation of infinitesimally close trajectories

In mathematics, the Lyapunov exponent or Lyapunov characteristic exponent of a dynamical system is a quantity that characterizes the rate of separation of infinitesimally close trajectories. Quantitatively, two trajectories in phase space with initial separation vector diverge at a rate given by

<span class="mw-page-title-main">Attractor</span> Concept in dynamical systems

In the mathematical field of dynamical systems, an attractor is a set of states toward which a system tends to evolve, for a wide variety of starting conditions of the system. System values that get close enough to the attractor values remain close even if slightly disturbed.

<span class="mw-page-title-main">Quantum chaos</span> Branch of physics seeking to explain chaotic dynamical systems in terms of quantum theory

Quantum chaos is a branch of physics which studies how chaotic classical dynamical systems can be described in terms of quantum theory. The primary question that quantum chaos seeks to answer is: "What is the relationship between quantum mechanics and classical chaos?" The correspondence principle states that classical mechanics is the classical limit of quantum mechanics, specifically in the limit as the ratio of Planck's constant to the action of the system tends to zero. If this is true, then there must be quantum mechanisms underlying classical chaos. If quantum mechanics does not demonstrate an exponential sensitivity to initial conditions, how can exponential sensitivity to initial conditions arise in classical chaos, which must be the correspondence principle limit of quantum mechanics?

<span class="mw-page-title-main">Limit cycle</span> Behavior in a nonlinear system

In mathematics, in the study of dynamical systems with two-dimensional phase space, a limit cycle is a closed trajectory in phase space having the property that at least one other trajectory spirals into it either as time approaches infinity or as time approaches negative infinity. Such behavior is exhibited in some nonlinear systems. Limit cycles have been used to model the behavior of a great many real-world oscillatory systems. The study of limit cycles was initiated by Henri Poincaré (1854–1912).

The old quantum theory is a collection of results from the years 1900–1925 which predate modern quantum mechanics. The theory was never complete or self-consistent, but was rather a set of heuristic corrections to classical mechanics. The theory is now understood as the semi-classical approximation to modern quantum mechanics. The main and final accomplishments of the old quantum theory were the determination of the modern form of the periodic table by Edmund Stoner and the Pauli Exclusion Principle which were both premised on the Arnold Sommerfeld enhancements to the Bohr model of the atom.

<span class="mw-page-title-main">Van der Pol oscillator</span>

In dynamics, the Van der Pol oscillator is a non-conservative oscillator with non-linear damping. It evolves in time according to the second-order differential equation:

<span class="mw-page-title-main">Bifurcation theory</span> Study of sudden qualitative behavior changes caused by small parameter changes

Bifurcation theory is the mathematical study of changes in the qualitative or topological structure of a given family of curves, such as the integral curves of a family of vector fields, and the solutions of a family of differential equations. Most commonly applied to the mathematical study of dynamical systems, a bifurcation occurs when a small smooth change made to the parameter values of a system causes a sudden 'qualitative' or topological change in its behavior. Bifurcations occur in both continuous systems and discrete systems.

The mathematical expressions for thermodynamic entropy in the statistical thermodynamics formulation established by Ludwig Boltzmann and J. Willard Gibbs in the 1870s are similar to the information entropy by Claude Shannon and Ralph Hartley, developed in the 1940s.

<span class="mw-page-title-main">Lorenz system</span> System of ordinary differential equations with chaotic solutions

The Lorenz system is a system of ordinary differential equations first studied by mathematician and meteorologist Edward Lorenz. It is notable for having chaotic solutions for certain parameter values and initial conditions. In particular, the Lorenz attractor is a set of chaotic solutions of the Lorenz system. In popular media the "butterfly effect" stems from the real-world implications of the Lorenz attractor, namely that in a chaotic physical system, in the absence of perfect knowledge of the initial conditions, our ability to predict its future course will always fail. This underscores that physical systems can be completely deterministic and yet still be inherently unpredictable. The shape of the Lorenz attractor itself, when plotted in phase space, may also be seen to resemble a butterfly.

In lab experiments that study chaos theory, approaches designed to control chaos are based on certain observed system behaviors. Any chaotic attractor contains an infinite number of unstable, periodic orbits. Chaotic dynamics, then, consists of a motion where the system state moves in the neighborhood of one of these orbits for a while, then falls close to a different unstable, periodic orbit where it remains for a limited time and so forth. This results in a complicated and unpredictable wandering over longer periods of time.

Synchronization of chaos is a phenomenon that may occur when two or more dissipative chaotic systems are coupled.

<span class="mw-page-title-main">Endoreversible thermodynamics</span>

Endoreversible thermodynamics is a subset of irreversible thermodynamics aimed at making more realistic assumptions about heat transfer than are typically made in reversible thermodynamics. It gives an upper bound on the energy that can be derived from a real process that is lower than that predicted by Carnot for a Carnot cycle, and accommodates the exergy destruction occurring as heat is transferred irreversibly.

In the bifurcation theory, a bounded oscillation that is born without loss of stability of stationary set is called a hidden oscillation. In nonlinear control theory, the birth of a hidden oscillation in a time-invariant control system with bounded states means crossing a boundary, in the domain of the parameters, where local stability of the stationary states implies global stability. If a hidden oscillation attracts all nearby oscillations, then it is called a hidden attractor. For a dynamical system with a unique equilibrium point that is globally attractive, the birth of a hidden attractor corresponds to a qualitative change in behaviour from monostability to bi-stability. In the general case, a dynamical system may turn out to be multistable and have coexisting local attractors in the phase space. While trivial attractors, i.e. stable equilibrium points, can be easily found analytically or numerically, the search of periodic and chaotic attractors can turn out to be a challenging problem.

Celso Grebogi is a Brazilian theoretical physicist who works in the area of chaos theory. He is one among the pioneers in the nonlinear and complex systems and chaos theory. Currently he works at the University of Aberdeen as the "Sixth Century Chair in Nonlinear and Complex Systems". He has done extensive research in the field of plasma physics before his work on the theory of dynamical systems. He and his colleagues have shown with a numerical example that one can convert a chaotic attractor to any one of numerous possible attracting time-periodic motions by making only small time-dependent perturbations of an available system parameter. This article is considered as one among the classic works in the control theory of chaos and their control method is known as the OGY method. He was listed in the 2016 Thomson Reuters Citation Laureates.

References

  1. 1 2 3 4 5 Ott, Edward; Grebogi, Celso; Yorke, James A. (1990-03-12). "Controlling chaos". Physical Review Letters. American Physical Society (APS). 64 (11): 1196–1199. Bibcode:1990PhRvL..64.1196O. doi:10.1103/physrevlett.64.1196. ISSN   0031-9007. PMID   10041332.
  2. Pyragas, K. (1992). "Continuous control of chaos by self-controlling feedback". Physics Letters A. Elsevier BV. 170 (6): 421–428. Bibcode:1992PhLA..170..421P. doi:10.1016/0375-9601(92)90745-8. ISSN   0375-9601.
  3. Fradkov A.L., Pogromsky A.Yu., Introduction to control of oscillations and chaos. Singapore: World Scientific Publ., 1998.
  4. 1 2 Andrievskii, B. R. (2003). "Control of Chaos: Methods and Applications. I. Methods". Automation and Remote Control. Springer Nature. 64 (5): 673–713. doi:10.1023/a:1023684619933. ISSN   0005-1179. S2CID   117993497.
  5. 1 2 Andrievskii, B. R.; Fradkov, A. L. (2004). "Control of Chaos: Methods and Applications. II. Applications". Automation and Remote Control. Springer Nature. 65 (4): 505–533. doi:10.1023/b:aurc.0000023528.59389.09. ISSN   0005-1179. S2CID   33466494.
  6. Handbook of Chaos Control, Second completely revised and enlarged edition, Eds: E. Schoell, H.G. Schuster. Wiley-VCH, 2007.
  7. 1 2 Fradkov, Alexander (1999). "Exploring nonlinearity by feedback" (PDF). Physica D: Nonlinear Phenomena. Elsevier BV. 128 (2–4): 159–168. Bibcode:1999PhyD..128..159F. doi:10.1016/s0167-2789(98)00322-4. ISSN   0167-2789.
  8. Fradkov AL. Investigation of physical systems by feedback. Autom. Remote Control 60 (3): 471-483, 1999.
  9. Leff H.S. and A.F.Rex (Eds). Maxwell's Demon 2: entropy, classical and quantum information, computing: 2nd edition. Institute of Physics. 2003.
  10. Butkovskii A.G., Samoilenko Yu.I. Control of Quantum-Mechanical Processes. Dordrecht: Kluwer Acad. Publ., 1990 (In Russian: Moscow: Nauka, 1984,
  11. 1 2 Novikov I.I., The efficiency of atomic power stations, Atomic Energy 3 (11), 409--412, 1957; (English translation: Nuclear Energy II 7. 125–-128, 1958).
  12. 1 2 Curzon, F. L.; Ahlborn, B. (1975). "Efficiency of a Carnot engine at maximum power output". American Journal of Physics. American Association of Physics Teachers (AAPT). 43 (1): 22–24. Bibcode:1975AmJPh..43...22C. doi:10.1119/1.10023. ISSN   0002-9505.
  13. Berry R.S., Kazakov V.A., Sieniutycz S., Szwast Z., Tsirlin A.M. Thermodynamic Optimization of Finite Time Processes. Wiley. N.Y., 2000.
  14. Fradkov A.L. Investigation of physical systems by means of feedback. Autom. Remote Control. V. 60, 1999, N 3, pp.3-22
  15. 1 2 Fradkov, Aleksandr L (2005-02-28). "Application of cybernetic methods in physics". Physics-Uspekhi. Uspekhi Fizicheskikh Nauk (UFN) Journal. 48 (2): 103–127. doi:10.1070/pu2005v048n02abeh002047. ISSN   1063-7869. S2CID   250759379.
  16. 1 2 Fradkov A.L. Cybernetical physics: from control of chaos to quantum control. Springer-Verlag, 2007, (Preliminary Russian version: St.Petersburg, Nauka, 2003).