This article may be too technical for most readers to understand.(December 2023) |
The Lorenz system is a system of ordinary differential equations first studied by mathematician and meteorologist Edward Lorenz. It is notable for having chaotic solutions for certain parameter values and initial conditions. In particular, the Lorenz attractor is a set of chaotic solutions of the Lorenz system. The term "butterfly effect" in popular media may stem from the real-world implications of the Lorenz attractor, namely that several different initial chaotic conditions evolve in phase space in a way that never repeats, so all chaos is unpredictable. This underscores that chaotic systems can be completely deterministic and yet still be inherently unpredictable over long periods of time. Because chaos continually increases in systems, it is impossible to predict the future of systems well. For instance, even the small flap of a butterfly's wings could set the world on a vastly different trajectory, such as by causing a hurricane. The shape of the Lorenz attractor itself, when plotted in phase space, may also be seen to resemble a butterfly.
In 1963, Edward Lorenz, with the help of Ellen Fetter who was responsible for the numerical simulations and figures, [1] and Margaret Hamilton who helped in the initial, numerical computations leading up to the findings of the Lorenz model, [2] developed a simplified mathematical model for atmospheric convection. [1] The model is a system of three ordinary differential equations now known as the Lorenz equations:
The equations relate the properties of a two-dimensional fluid layer uniformly warmed from below and cooled from above. In particular, the equations describe the rate of change of three quantities with respect to time: x is proportional to the rate of convection, y to the horizontal temperature variation, and z to the vertical temperature variation. [3] The constants σ, ρ, and β are system parameters proportional to the Prandtl number, Rayleigh number, and certain physical dimensions of the layer itself. [3]
The Lorenz equations can arise in simplified models for lasers, [4] dynamos, [5] thermosyphons, [6] brushless DC motors, [7] electric circuits, [8] chemical reactions [9] and forward osmosis. [10] The Lorenz equations are also the governing equations in Fourier space for the Malkus waterwheel. [11] [12] The Malkus waterwheel exhibits chaotic motion where instead of spinning in one direction at a constant speed, its rotation will speed up, slow down, stop, change directions, and oscillate back and forth between combinations of such behaviors in an unpredictable manner.
From a technical standpoint, the Lorenz system is nonlinear, aperiodic, three-dimensional and deterministic. The Lorenz equations have been the subject of hundreds of research articles, and at least one book-length study. [3]
One normally assumes that the parameters σ, ρ, and β are positive. Lorenz used the values σ = 10, β = 8/3 and ρ = 28. The system exhibits chaotic behavior for these (and nearby) values. [13]
If ρ < 1 then there is only one equilibrium point, which is at the origin. This point corresponds to no convection. All orbits converge to the origin, which is a global attractor, when ρ < 1. [14]
A pitchfork bifurcation occurs at ρ = 1, and for ρ > 1 two additional critical points appear at
These correspond to steady convection. This pair of equilibrium points is stable only if
which can hold only for positive ρ if σ > β + 1. At the critical value, both equilibrium points lose stability through a subcritical Hopf bifurcation. [15]
When ρ = 28, σ = 10, and β = 8/3, the Lorenz system has chaotic solutions (but not all solutions are chaotic). Almost all initial points will tend to an invariant set –the Lorenz attractor –a strange attractor, a fractal, and a self-excited attractor with respect to all three equilibria. Its Hausdorff dimension is estimated from above by the Lyapunov dimension (Kaplan-Yorke dimension) as 2.06±0.01, [16] and the correlation dimension is estimated to be 2.05±0.01. [17] The exact Lyapunov dimension formula of the global attractor can be found analytically under classical restrictions on the parameters: [18] [16] [19]
The Lorenz attractor is difficult to analyze, but the action of the differential equation on the attractor is described by a fairly simple geometric model. [20] Proving that this is indeed the case is the fourteenth problem on the list of Smale's problems. This problem was the first one to be resolved, by Warwick Tucker in 2002. [21]
For other values of ρ, the system displays knotted periodic orbits. For example, with ρ = 99.96 it becomes a T(3,2) torus knot.
Example solutions of the Lorenz system for different values of ρ | |
---|---|
ρ = 14, σ = 10, β = 8/3 (Enlarge) | ρ = 13, σ = 10, β = 8/3 (Enlarge) |
ρ = 15, σ = 10, β = 8/3 (Enlarge) | ρ = 28, σ = 10, β = 8/3 (Enlarge) |
For small values of ρ, the system is stable and evolves to one of two fixed point attractors. When ρ > 24.74, the fixed points become repulsors and the trajectory is repelled by them in a very complex way. |
Sensitive dependence on the initial condition | ||
---|---|---|
Time t = 1 (Enlarge) | Time t = 2 (Enlarge) | Time t = 3 (Enlarge) |
These figures — made using ρ = 28, σ = 10 and β = 8/3 — show three time segments of the 3-D evolution of two trajectories (one in blue, the other in yellow) in the Lorenz attractor starting at two initial points that differ only by 10−5 in the x-coordinate. Initially, the two trajectories seem coincident (only the yellow one can be seen, as it is drawn over the blue one) but, after some time, the divergence is obvious. |
In Figure 4 of his paper, [1] Lorenz plotted the relative maximum value in the z direction achieved by the system against the previous relative maximum in the z direction. This procedure later became known as a Lorenz map (not to be confused with a Poincaré plot, which plots the intersections of a trajectory with a prescribed surface). The resulting plot has a shape very similar to the tent map. Lorenz also found that when the maximum z value is above a certain cut-off, the system will switch to the next lobe. Combining this with the chaos known to be exhibited by the tent map, he showed that the system switches between the two lobes chaotically.
Over the past several years, a series of papers regarding high-dimensional Lorenz models have yielded a generalized Lorenz model, [22] which can be simplified into the classical Lorenz model for three state variables or the following five-dimensional Lorenz model for five state variables: [23]
A choice of the parameter d0 = 19/3 has been applied to be consistent with the choice of the other parameters. See details in. [22] [23]
usingPlots# define the Lorenz attractor@kwdefmutablestructLorenzdt::Float64=0.02σ::Float64=10ρ::Float64=28β::Float64=8/3x::Float64=2y::Float64=1z::Float64=1endfunctionstep!(l::Lorenz)dx=l.σ*(l.y-l.x);l.x+=l.dt*dxdy=l.x*(l.ρ-l.z)-l.y;l.y+=l.dt*dydz=l.x*l.y-l.β*l.z;l.z+=l.dt*dzendattractor=Lorenz()# initialize a 3D plot with 1 empty seriesplt=plot3d(1,xlim=(-30,30),ylim=(-30,30),zlim=(0,60),title="Lorenz Attractor",marker=2,)# build an animated gif by pushing new points to the plot, saving every 10th frame@giffori=1:1500step!(attractor)push!(plt,attractor.x,attractor.y,attractor.z)endevery10
deq:=[diff(x(t),t)=10*(y(t)-x(t)),diff(y(t),t)=28*x(t)-y(t)-x(t)*z(t),diff(z(t),t)=x(t)*y(t)-8/3*z(t)]:with(DEtools):DEplot3d(deq,{x(t),y(t),z(t)},t=0..100,[[x(0)=10,y(0)=10,z(0)=10]],stepsize=0.01,x=-20..20,y=-25..25,z=0..50,linecolour=sin(t*Pi/3),thickness=1,orientation=[-40,80],title=`Lorenz Chaotic Attractor`);
[sigma,rho,beta]:[10,28,8/3]$eq:[sigma*(y-x),x*(rho-z)-y,x*y-beta*z]$sol:rk(eq,[x,y,z],[1,0,0],[t,0,50,1/100])$len:length(sol)$x:makelist(sol[k][2],k,len)$y:makelist(sol[k][3],k,len)$z:makelist(sol[k][4],k,len)$draw3d(points_joined=true,point_type=-1,points(x,y,z),proportional_axes=xyz)$
% Solve over time interval [0,100] with initial conditions [1,1,1]% ''f'' is set of differential equations% ''a'' is array containing x, y, and z variables% ''t'' is time variablesigma=10;beta=8/3;rho=28;f=@(t,a)[-sigma*a(1)+sigma*a(2);rho*a(1)-a(2)-a(1)*a(3);-beta*a(3)+a(1)*a(2)];[t,a]=ode45(f,[0100],[111]);% Runge-Kutta 4th/5th order ODE solverplot3(a(:,1),a(:,2),a(:,3))
Standard way:
tend=50;eq={x'[t]==σ(y[t]-x[t]),y'[t]==x[t](ρ-z[t])-y[t],z'[t]==x[t]y[t]-βz[t]};init={x[0]==10,y[0]==10,z[0]==10};pars={σ->10,ρ->28,β->8/3};{xs,ys,zs}=NDSolveValue[{eq/.pars,init},{x,y,z},{t,0,tend}];ParametricPlot3D[{xs[t],ys[t],zs[t]},{t,0,tend}]
Less verbose:
lorenz=NonlinearStateSpaceModel[{{σ(y-x),x(ρ-z)-y,xy-βz},{}},{x,y,z},{σ,ρ,β}];soln[t_]=StateResponse[{lorenz,{10,10,10}},{10,28,8/3},{t,0,50}];ParametricPlot3D[soln[t],{t,0,50}]
importmatplotlib.pyplotaspltimportnumpyasnpdeflorenz(xyz,*,s=10,r=28,b=2.667):""" Parameters ---------- xyz : array-like, shape (3,) Point of interest in three-dimensional space. s, r, b : float Parameters defining the Lorenz attractor. Returns ------- xyz_dot : array, shape (3,) Values of the Lorenz attractor's partial derivatives at *xyz*. """x,y,z=xyzx_dot=s*(y-x)y_dot=r*x-y-x*zz_dot=x*y-b*zreturnnp.array([x_dot,y_dot,z_dot])dt=0.01num_steps=10000xyzs=np.empty((num_steps+1,3))# Need one more for the initial valuesxyzs[0]=(0.,1.,1.05)# Set initial values# Step through "time", calculating the partial derivatives at the current point# and using them to estimate the next pointforiinrange(num_steps):xyzs[i+1]=xyzs[i]+lorenz(xyzs[i])*dt# Plotax=plt.figure().add_subplot(projection='3d')ax.plot(*xyzs.T,lw=0.6)ax.set_xlabel("X Axis")ax.set_ylabel("Y Axis")ax.set_zlabel("Z Axis")ax.set_title("Lorenz Attractor")plt.show()
library(deSolve)library(plotly)# parametersprm<-list(sigma=10,rho=28,beta=8/3)# initial valuesvarini<-c(X=1,Y=1,Z=1)Lorenz<-function (t,vars,prm){with(as.list(vars),{dX<-prm$sigma*(Y-X)dY<-X*(prm$rho-Z)-YdZ<-X*Y-prm$beta*Zreturn(list(c(dX,dY,dZ)))})}times<-seq(from=0,to=100,by=0.01)# call ode solverout<-ode(y=varini,times=times,func=Lorenz,parms=prm)# to assign color to pointsgfill<-function (repArr,long){rep(repArr,ceiling(long/length(repArr)))[1:long]}dout<-as.data.frame(out)dout$color<-gfill(rainbow(10),nrow(dout))# Graphics production with Plotly:plot_ly(data=dout,x=~X,y=~Y,z=~Z,type='scatter3d',mode='lines',opacity=1,line=list(width=6,color=~color,reverscale=FALSE))
As shown in Lorenz's original paper, [24] the Lorenz system is a reduced version of a larger system studied earlier by Barry Saltzman. [25] The Lorenz equations are derived from the Oberbeck–Boussinesq approximation to the equations describing fluid circulation in a shallow layer of fluid, heated uniformly from below and cooled uniformly from above. [26] This fluid circulation is known as Rayleigh–Bénard convection. The fluid is assumed to circulate in two dimensions (vertical and horizontal) with periodic rectangular boundary conditions. [27]
The partial differential equations modeling the system's stream function and temperature are subjected to a spectral Galerkin approximation: the hydrodynamic fields are expanded in Fourier series, which are then severely truncated to a single term for the stream function and two terms for the temperature. This reduces the model equations to a set of three coupled, nonlinear ordinary differential equations. A detailed derivation may be found, for example, in nonlinear dynamics texts from Hilborn (2000), Appendix C; Bergé, Pomeau & Vidal (1984), Appendix D; or Shen (2016), [28] Supplementary Materials.
The scientific community accepts that the chaotic features found in low-dimensional Lorenz models could represent features of the Earth's atmosphere ( [29] [30] [31] ), yielding the statement of “weather is chaotic.” By comparison, based on the concept of attractor coexistence within the generalized Lorenz model [22] and the original Lorenz model ( [32] [33] ), Shen and his co-authors [31] [34] proposed a revised view that “weather possesses both chaos and order with distinct predictability”. The revised view, which is a build-up of the conventional view, is used to suggest that “the chaotic and regular features found in theoretical Lorenz models could better represent features of the Earth's atmosphere”.
Smale's 14th problem says, 'Do the properties of the Lorenz attractor exhibit that of a strange attractor?'. The problem was answered affirmatively by Warwick Tucker in 2002. [21] To prove this result, Tucker used rigorous numerics methods like interval arithmetic and normal forms. First, Tucker defined a cross section that is cut transversely by the flow trajectories. From this, one can define the first-return map , which assigns to each the point where the trajectory of first intersects .
Then the proof is split in three main points that are proved and imply the existence of a strange attractor. [35] The three points are:
To prove the first point, we notice that the cross section is cut by two arcs formed by . [35] Tucker covers the location of these two arcs by small rectangles , the union of these rectangles gives . Now, the goal is to prove that for all points in , the flow will bring back the points in , in . To do that, we take a plan below at a distance small, then by taking the center of and using Euler integration method, one can estimate where the flow will bring in which gives us a new point . Then, one can estimate where the points in will be mapped in using Taylor expansion, this gives us a new rectangle centered on . Thus we know that all points in will be mapped in . The goal is to do this method recursively until the flow comes back to and we obtain a rectangle in such that we know that . The problem is that our estimation may become imprecise after several iterations, thus what Tucker does is to split into smaller rectangles and then apply the process recursively. Another problem is that as we are applying this algorithm, the flow becomes more 'horizontal', [35] leading to a dramatic increase in imprecision. To prevent this, the algorithm changes the orientation of the cross sections, becoming either horizontal or vertical.
Chaos theory is an interdisciplinary area of scientific study and branch of mathematics. It focuses on underlying patterns and deterministic laws of dynamical systems that are highly sensitive to initial conditions. These were once thought to have completely random states of disorder and irregularities. Chaos theory states that within the apparent randomness of chaotic complex systems, there are underlying patterns, interconnection, constant feedback loops, repetition, self-similarity, fractals and self-organization. The butterfly effect, an underlying principle of chaos, describes how a small change in one state of a deterministic nonlinear system can result in large differences in a later state. A metaphor for this behavior is that a butterfly flapping its wings in Brazil can cause a tornado in Texas.
The Navier–Stokes equations are partial differential equations which describe the motion of viscous fluid substances. They were named after French engineer and physicist Claude-Louis Navier and the Irish physicist and mathematician George Gabriel Stokes. They were developed over several decades of progressively building the theories, from 1822 (Navier) to 1842–1850 (Stokes).
In probability theory and statistics, the multivariate normal distribution, multivariate Gaussian distribution, or joint normal distribution is a generalization of the one-dimensional (univariate) normal distribution to higher dimensions. One definition is that a random vector is said to be k-variate normally distributed if every linear combination of its k components has a univariate normal distribution. Its importance derives mainly from the multivariate central limit theorem. The multivariate normal distribution is often used to describe, at least approximately, any set of (possibly) correlated real-valued random variables, each of which clusters around a mean value.
In quantum mechanics, a density matrix is a matrix that describes the quantum state of a physical system. It allows for the calculation of the probabilities of the outcomes of any measurement performed upon this system, using the Born rule. It is a generalization of the more usual state vectors or wavefunctions: while those can only represent pure states, density matrices can also represent mixed states. Mixed states arise in quantum mechanics in two different situations:
In the mathematical field of differential geometry, the Riemann curvature tensor or Riemann–Christoffel tensor is the most common way used to express the curvature of Riemannian manifolds. It assigns a tensor to each point of a Riemannian manifold. It is a local invariant of Riemannian metrics which measures the failure of the second covariant derivatives to commute. A Riemannian manifold has zero curvature if and only if it is flat, i.e. locally isometric to the Euclidean space. The curvature tensor can also be defined for any pseudo-Riemannian manifold, or indeed any manifold equipped with an affine connection.
Linear elasticity is a mathematical model of how solid objects deform and become internally stressed due to prescribed loading conditions. It is a simplification of the more general nonlinear theory of elasticity and a branch of continuum mechanics.
In econometrics, the autoregressive conditional heteroskedasticity (ARCH) model is a statistical model for time series data that describes the variance of the current error term or innovation as a function of the actual sizes of the previous time periods' error terms; often the variance is related to the squares of the previous innovations. The ARCH model is appropriate when the error variance in a time series follows an autoregressive (AR) model; if an autoregressive moving average (ARMA) model is assumed for the error variance, the model is a generalized autoregressive conditional heteroskedasticity (GARCH) model.
A vibration in a string is a wave. Resonance causes a vibrating string to produce a sound with constant frequency, i.e. constant pitch. If the length or tension of the string is correctly adjusted, the sound produced is a musical tone. Vibrating strings are the basis of string instruments such as guitars, cellos, and pianos.
In applied mechanics, bending characterizes the behavior of a slender structural element subjected to an external load applied perpendicularly to a longitudinal axis of the element.
The dyadic transformation is the mapping
In theoretical physics and mathematics, a Wess–Zumino–Witten (WZW) model, also called a Wess–Zumino–Novikov–Witten model, is a type of two-dimensional conformal field theory named after Julius Wess, Bruno Zumino, Sergei Novikov and Edward Witten. A WZW model is associated to a Lie group, and its symmetry algebra is the affine Lie algebra built from the corresponding Lie algebra. By extension, the name WZW model is sometimes used for any conformal field theory whose symmetry algebra is an affine Lie algebra.
Euler–Bernoulli beam theory is a simplification of the linear theory of elasticity which provides a means of calculating the load-carrying and deflection characteristics of beams. It covers the case corresponding to small deflections of a beam that is subjected to lateral loads only. By ignoring the effects of shear deformation and rotatory inertia, it is thus a special case of Timoshenko–Ehrenfest beam theory. It was first enunciated circa 1750, but was not applied on a large scale until the development of the Eiffel Tower and the Ferris wheel in the late 19th century. Following these successful demonstrations, it quickly became a cornerstone of engineering and an enabler of the Second Industrial Revolution.
The Duffing equation, named after Georg Duffing (1861–1944), is a non-linear second-order differential equation used to model certain damped and driven oscillators. The equation is given by
The covariant formulation of classical electromagnetism refers to ways of writing the laws of classical electromagnetism in a form that is manifestly invariant under Lorentz transformations, in the formalism of special relativity using rectilinear inertial coordinate systems. These expressions both make it simple to prove that the laws of classical electromagnetism take the same form in any inertial coordinate system, and also provide a way to translate the fields and forces from one frame to another. However, this is not as general as Maxwell's equations in curved spacetime or non-rectilinear coordinate systems.
In physics, Maxwell's equations in curved spacetime govern the dynamics of the electromagnetic field in curved spacetime or where one uses an arbitrary coordinate system. These equations can be viewed as a generalization of the vacuum Maxwell's equations which are normally formulated in the local coordinates of flat spacetime. But because general relativity dictates that the presence of electromagnetic fields induce curvature in spacetime, Maxwell's equations in flat spacetime should be viewed as a convenient approximation.
The shallow-water equations (SWE) are a set of hyperbolic partial differential equations that describe the flow below a pressure surface in a fluid. The shallow-water equations in unidirectional form are also called Saint-Venant equations, after Adhémar Jean Claude Barré de Saint-Venant.
In probability theory and statistics, partial correlation measures the degree of association between two random variables, with the effect of a set of controlling random variables removed. When determining the numerical relationship between two variables of interest, using their correlation coefficient will give misleading results if there is another confounding variable that is numerically related to both variables of interest. This misleading information can be avoided by controlling for the confounding variable, which is done by computing the partial correlation coefficient. This is precisely the motivation for including other right-side variables in a multiple regression; but while multiple regression gives unbiased results for the effect size, it does not give a numerical value of a measure of the strength of the relationship between the two variables of interest.
There are various mathematical descriptions of the electromagnetic field that are used in the study of electromagnetism, one of the four fundamental interactions of nature. In this article, several approaches are discussed, although the equations are in terms of electric and magnetic fields, potentials, and charges with currents, generally speaking.
In mathematics – specifically, in stochastic analysis – an Itô diffusion is a solution to a specific type of stochastic differential equation. That equation is similar to the Langevin equation used in physics to describe the Brownian motion of a particle subjected to a potential in a viscous fluid. Itô diffusions are named after the Japanese mathematician Kiyosi Itô.
In statistics, the Innovation Method provides an estimator for the parameters of stochastic differential equations given a time series of observations of the state variables. In the framework of continuous-discrete state space models, the innovation estimator is obtained by maximizing the log-likelihood of the corresponding discrete-time innovation process with respect to the parameters. The innovation estimator can be classified as a M-estimator, a quasi-maximum likelihood estimator or a prediction error estimator depending on the inferential considerations that want to be emphasized. The innovation method is a system identification technique for developing mathematical models of dynamical systems from measured data and for the optimal design of experiments.