State observer

Last updated

In control theory, a state observer or state estimator is a system that provides an estimate of the internal state of a given real system, from measurements of the input and output of the real system. It is typically computer-implemented, and provides the basis of many practical applications.

Contents

Knowing the system state is necessary to solve many control theory problems; for example, stabilizing a system using state feedback. In most practical cases, the physical state of the system cannot be determined by direct observation. Instead, indirect effects of the internal state are observed by way of the system outputs. A simple example is that of vehicles in a tunnel: the rates and velocities at which vehicles enter and leave the tunnel can be observed directly, but the exact state inside the tunnel can only be estimated. If a system is observable, it is possible to fully reconstruct the system state from its output measurements using the state observer.

Typical observer model

Block diagram of Luenberger Observer. Input of observer gain L is
y
-
y
^
{\displaystyle y\mathbf {-} {\hat {y}}}
. Luenberger Observer.svg
Block diagram of Luenberger Observer. Input of observer gain L is .

Linear, delayed, sliding mode, high gain, Tau, homogeneity-based, extended and cubic observers are among several observer structures used for state estimation of linear and nonlinear systems. A linear observer structure is described in the following sections.

Discrete-time case

The state of a linear, time-invariant discrete-time system is assumed to satisfy

where, at time , is the plant's state; is its inputs; and is its outputs. These equations simply say that the plant's current outputs and its future state are both determined solely by its current states and the current inputs. (Although these equations are expressed in terms of discrete time steps, very similar equations hold for continuous systems). If this system is observable then the output of the plant, , can be used to steer the state of the state observer.

The observer model of the physical system is then typically derived from the above equations. Additional terms may be included in order to ensure that, on receiving successive measured values of the plant's inputs and outputs, the model's state converges to that of the plant. In particular, the output of the observer may be subtracted from the output of the plant and then multiplied by a matrix ; this is then added to the equations for the state of the observer to produce a so-called Luenberger observer, defined by the equations below. Note that the variables of a state observer are commonly denoted by a "hat": and to distinguish them from the variables of the equations satisfied by the physical system.

The observer is called asymptotically stable if the observer error converges to zero when . For a Luenberger observer, the observer error satisfies . The Luenberger observer for this discrete-time system is therefore asymptotically stable when the matrix has all the eigenvalues inside the unit circle.

For control purposes the output of the observer system is fed back to the input of both the observer and the plant through the gains matrix .

The observer equations then become:

or, more simply,

Due to the separation principle we know that we can choose and independently without harm to the overall stability of the systems. As a rule of thumb, the poles of the observer are usually chosen to converge 10 times faster than the poles of the system .

Continuous-time case

The previous example was for an observer implemented in a discrete-time LTI system. However, the process is similar for the continuous-time case; the observer gains are chosen to make the continuous-time error dynamics converge to zero asymptotically (i.e., when is a Hurwitz matrix).

For a continuous-time linear system

where , the observer looks similar to discrete-time case described above:

.

The observer error satisfies the equation

.

The eigenvalues of the matrix can be chosen arbitrarily by appropriate choice of the observer gain when the pair is observable, i.e. observability condition holds. In particular, it can be made Hurwitz, so the observer error when .

Peaking and other observer methods

When the observer gain is high, the linear Luenberger observer converges to the system states very quickly. However, high observer gain leads to a peaking phenomenon in which initial estimator error can be prohibitively large (i.e., impractical or unsafe to use). [1] As a consequence, nonlinear high-gain observer methods are available that converge quickly without the peaking phenomenon. For example, sliding mode control can be used to design an observer that brings one estimated state's error to zero in finite time even in the presence of measurement error; the other states have error that behaves similarly to the error in a Luenberger observer after peaking has subsided. Sliding mode observers also have attractive noise resilience properties that are similar to a Kalman filter. [2] [3] Another approach is to apply multi observer, that significantly improves transients and reduces observer overshoot. Multi-observer can be adapted to every system where high-gain observer is applicable. [4]

State observers for nonlinear systems

High gain, sliding mode and extended observers are the most common observers for nonlinear systems. To illustrate the application of sliding mode observers for nonlinear systems, first consider the no-input non-linear system:

where . Also assume that there is a measurable output given by

There are several non-approximate approaches for designing an observer. The two observers given below also apply to the case when the system has an input. That is,

Linearizable error dynamics

One suggestion by Krener and Isidori [5] and Krener and Respondek [6] can be applied in a situation when there exists a linearizing transformation (i.e., a diffeomorphism, like the one used in feedback linearization) such that in new variables the system equations read

The Luenberger observer is then designed as

.

The observer error for the transformed variable satisfies the same equation as in classical linear case.

.

As shown by Gauthier, Hammouri, and Othman [7] and Hammouri and Kinnaert, [8] if there exists transformation such that the system can be transformed into the form

then the observer is designed as

,

where is a time-varying observer gain.

Ciccarella, Dalla Mora, and Germani [9] obtained more advanced and general results, removing the need for a nonlinear transform and proving global asymptotic convergence of the estimated state to the true state using only simple assumptions on regularity.

Switched observers

As discussed for the linear case above, the peaking phenomenon present in Luenberger observers justifies the use of switched observers. A switched observer encompasses a relay or binary switch that acts upon detecting minute changes in the measured output. Some common types of switched observers include the sliding mode observer, nonlinear extended state observer, [10] fixed time observer, [11] switched high gain observer [12] and uniting observer. [13] The sliding mode observer uses non-linear high-gain feedback to drive estimated states to a hypersurface where there is no difference between the estimated output and the measured output. The non-linear gain used in the observer is typically implemented with a scaled switching function, like the signum (i.e., sgn) of the estimated – measured output error. Hence, due to this high-gain feedback, the vector field of the observer has a crease in it so that observer trajectories slide along a curve where the estimated output matches the measured output exactly. So, if the system is observable from its output, the observer states will all be driven to the actual system states. Additionally, by using the sign of the error to drive the sliding mode observer, the observer trajectories become insensitive to many forms of noise. Hence, some sliding mode observers have attractive properties similar to the Kalman filter but with simpler implementation. [2] [3]

As suggested by Drakunov, [14] a sliding mode observer can also be designed for a class of non-linear systems. Such an observer can be written in terms of original variable estimate and has the form

where:

The idea can be briefly explained as follows. According to the theory of sliding modes, in order to describe the system behavior, once sliding mode starts, the function should be replaced by equivalent values (see equivalent control in the theory of sliding modes). In practice, it switches (chatters) with high frequency with slow component being equal to the equivalent value. Applying appropriate lowpass filter to get rid of the high frequency component on can obtain the value of the equivalent control, which contains more information about the state of the estimated system. The observer described above uses this method several times to obtain the state of the nonlinear system ideally in finite time.

The modified observation error can be written in the transformed states . In particular,

and so

So:

  1. As long as , the first row of the error dynamics, , will meet sufficient conditions to enter the sliding mode in finite time.
  2. Along the surface, the corresponding equivalent control will be equal to , and so . Hence, so long as , the second row of the error dynamics, , will enter the sliding mode in finite time.
  3. Along the surface, the corresponding equivalent control will be equal to . Hence, so long as , the th row of the error dynamics, , will enter the sliding mode in finite time.

So, for sufficiently large gains, all observer estimated states reach the actual states in finite time. In fact, increasing allows for convergence in any desired finite time so long as each function can be bounded with certainty. Hence, the requirement that the map is a diffeomorphism (i.e., that its Jacobian linearization is invertible) asserts that convergence of the estimated output implies convergence of the estimated state. That is, the requirement is an observability condition.

In the case of the sliding mode observer for the system with the input, additional conditions are needed for the observation error to be independent of the input. For example, that

does not depend on time. The observer is then

Multi-observer

Multi-observer extends the high-gain observer structure from single to multi observer, with many models working simultaneously. This has two layers: the first consists of multiple high-gain observers with different estimation states, and the second determines the importance weights of the first layer observers. The algorithm is simple to implement and does not contain any risky operations like differentiation. [4] The idea of multiple models was previously applied to obtain information in adaptive control. [15]

Assuming that the number of high-gain observers equals ,

where is the observer index. The first layer observers consists of the same gain but they differ with the initial state . In the second layer all from observers are combined into one to obtain single state vector estimation

where are weight factors. These factors are changed to provide the estimation in the second layer and to improve the observation process.

Let assume that

and

where is some vector that depends on observer error .

Some transformation yields to linear regression problem

This formula gives possibility to estimate . To construct manifold we need mapping between and ensurance that is calculable relying on measurable signals. First thing is to eliminate parking phenomenon for from observer error

.

Calculate times derivative on to find mapping m lead to defined as

where is some time constant. Note that relays on both and its integrals hence it is easily available in the control system. Further is specified by estimation law; and thus it proves that manifold is measurable. In the second layer for is introduced as estimates of coefficients. The mapping error is specified as

where . If coefficients are equal to , then mapping error Now it is possible to calculate from above equation and hence the peaking phenomenon is reduced thanks to properties of manifold. The created mapping gives a lot of flexibility in the estimation process. Even it is possible to estimate the value of in the second layer and to calculate the state . [4]

Bounding observers

Bounding [16] or interval observers [17] [18] constitute a class of observers that provide two estimations of the state simultaneously: one of the estimations provides an upper bound on the real value of the state, whereas the second one provides a lower bound. The real value of the state is then known to be always within these two estimations.

These bounds are very important in practical applications, [19] [20] as they make possible to know at each time the precision of the estimation.

Mathematically, two Luenberger observers can be used, if is properly selected, using, for example, positive systems properties: [21] one for the upper bound (that ensures that converges to zero from above when , in the absence of noise and uncertainty), and a lower bound (that ensures that converges to zero from below). That is, always

See also

Related Research Articles

<span class="mw-page-title-main">Gradient</span> Multivariate derivative (mathematics)

In vector calculus, the gradient of a scalar-valued differentiable function of several variables is the vector field whose value at a point gives the direction and the rate of fastest increase. The gradient transforms like a vector under change of basis of the space of variables of . If the gradient of a function is non-zero at a point , the direction of the gradient is the direction in which the function increases most quickly from , and the magnitude of the gradient is the rate of increase in that direction, the greatest absolute directional derivative. Further, a point where the gradient is the zero vector is known as a stationary point. The gradient thus plays a fundamental role in optimization theory, where it is used to minimize a function by gradient descent. In coordinate-free terms, the gradient of a function may be defined by:

In linear algebra, a Toeplitz matrix or diagonal-constant matrix, named after Otto Toeplitz, is a matrix in which each descending diagonal from left to right is constant. For instance, the following matrix is a Toeplitz matrix:

In statistics, the Gauss–Markov theorem states that the ordinary least squares (OLS) estimator has the lowest sampling variance within the class of linear unbiased estimators, if the errors in the linear regression model are uncorrelated, have equal variances and expectation value of zero. The errors do not need to be normal for the theorem to apply, nor do they need to be independent and identically distributed.

<span class="mw-page-title-main">Kalman filter</span> Algorithm that estimates unknowns from a series of measurements over time

For statistics and control theory, Kalman filtering, also known as linear quadratic estimation (LQE), is an algorithm that uses a series of measurements observed over time, including statistical noise and other inaccuracies, and produces estimates of unknown variables that tend to be more accurate than those based on a single measurement alone, by estimating a joint probability distribution over the variables for each timeframe. The filter is named after Rudolf E. Kálmán, who was one of the primary developers of its theory.

<span class="mw-page-title-main">Covariance matrix</span> Measure of covariance of components of a random vector

In probability theory and statistics, a covariance matrix is a square matrix giving the covariance between each pair of elements of a given random vector.

<span class="mw-page-title-main">Adjoint representation</span> Mathematical term

In mathematics, the adjoint representation of a Lie group G is a way of representing the elements of the group as linear transformations of the group's Lie algebra, considered as a vector space. For example, if G is , the Lie group of real n-by-n invertible matrices, then the adjoint representation is the group homomorphism that sends an invertible n-by-n matrix to an endomorphism of the vector space of all linear transformations of defined by: .

In control systems, sliding mode control (SMC) is a nonlinear control method that alters the dynamics of a nonlinear system by applying a discontinuous control signal that forces the system to "slide" along a cross-section of the system's normal behavior. The state-feedback control law is not a continuous function of time. Instead, it can switch from one continuous structure to another based on the current position in the state space. Hence, sliding mode control is a variable structure control method. The multiple control structures are designed so that trajectories always move toward an adjacent region with a different control structure, and so the ultimate trajectory will not exist entirely within one control structure. Instead, it will slide along the boundaries of the control structures. The motion of the system as it slides along these boundaries is called a sliding mode and the geometrical locus consisting of the boundaries is called the sliding (hyper)surface. In the context of modern control theory, any variable structure system, like a system under SMC, may be viewed as a special case of a hybrid dynamical system as the system both flows through a continuous state space but also moves through different discrete control modes.

<span class="mw-page-title-main">Kriging</span> Method of interpolation

In statistics, originally in geostatistics, kriging or Kriging, also known as Gaussian process regression, is a method of interpolation based on Gaussian process governed by prior covariances. Under suitable assumptions of the prior, kriging gives the best linear unbiased prediction (BLUP) at unsampled locations. Interpolating methods based on other criteria such as smoothness may not yield the BLUP. The method is widely used in the domain of spatial analysis and computer experiments. The technique is also known as Wiener–Kolmogorov prediction, after Norbert Wiener and Andrey Kolmogorov.

In linear algebra, the Frobenius companion matrix of the monic polynomial

In control engineering and system identification, a state-space representation is a mathematical model of a physical system specified as a set of input, output, and variables related by first-order differential equations or difference equations. Such variables, called state variables, evolve over time in a way that depends on the values they have at any given instant and on the externally imposed values of input variables. Output variables’ values depend on the state variable values and may also depend on the input variable values.

Observability is a measure of how well internal states of a system can be inferred from knowledge of its external outputs. In control theory, the observability and controllability of a linear system are mathematical duals.

In mathematics, the kernel of a linear map, also known as the null space or nullspace, is the linear subspace of the domain of the map which is mapped to the zero vector. That is, given a linear map L : VW between two vector spaces V and W, the kernel of L is the vector space of all elements v of V such that L(v) = 0, where 0 denotes the zero vector in W, or more symbolically:

In statistics, ordinary least squares (OLS) is a type of linear least squares method for choosing the unknown parameters in a linear regression model by the principle of least squares: minimizing the sum of the squares of the differences between the observed dependent variable in the input dataset and the output of the (linear) function of the independent variable.

In statistics, the number of degrees of freedom is the number of values in the final calculation of a statistic that are free to vary.

In numerical linear algebra, the method of successive over-relaxation (SOR) is a variant of the Gauss–Seidel method for solving a linear system of equations, resulting in faster convergence. A similar method can be used for any slowly converging iterative process.

<span class="mw-page-title-main">Feedback linearization</span> Approach used in controlling nonlinear systems

Feedback linearization is a common strategy employed in nonlinear control to control nonlinear systems. Feedback linearization techniques may be applied to nonlinear control systems of the form

In statistics, Bayesian multivariate linear regression is a Bayesian approach to multivariate linear regression, i.e. linear regression where the predicted outcome is a vector of correlated random variables rather than a single scalar random variable. A more general treatment of this approach can be found in the article MMSE estimator.

In statistics and signal processing, the orthogonality principle is a necessary and sufficient condition for the optimality of a Bayesian estimator. Loosely stated, the orthogonality principle says that the error vector of the optimal estimator is orthogonal to any possible estimator. The orthogonality principle is most commonly stated for linear estimators, but more general formulations are possible. Since the principle is a necessary and sufficient condition for optimality, it can be used to find the minimum mean square error estimator.

In structural engineering, the Bouc–Wen model of hysteresis is a hysteretic model typically employed to describe non-linear hysteretic systems. It was introduced by Robert Bouc and extended by Yi-Kwei Wen, who demonstrated its versatility by producing a variety of hysteretic patterns. This model is able to capture, in analytical form, a range of hysteretic cycle shapes matching the behaviour of a wide class of hysteretical systems. Due to its versatility and mathematical tractability, the Bouc–Wen model has gained popularity. It has been extended and applied to a wide variety of engineering problems, including multi-degree-of-freedom (MDOF) systems, buildings, frames, bidirectional and torsional response of hysteretic systems, two- and three-dimensional continua, soil liquefaction and base isolation systems. The Bouc–Wen model, its variants and extensions have been used in structural control—in particular, in the modeling of behaviour of magneto-rheological dampers, base-isolation devices for buildings and other kinds of damping devices. It has also been used in the modelling and analysis of structures built of reinforced concrete, steel, masonry, and timber.

In statistics, machine learning and algorithms, a tensor sketch is a type of dimensionality reduction that is particularly efficient when applied to vectors that have tensor structure. Such a sketch can be used to speed up explicit kernel methods, bilinear pooling in neural networks and is a cornerstone in many numerical linear algebra algorithms.

References

In-line references
  1. Khalil, H.K. (2002), Nonlinear Systems (3rd ed.), Upper Saddle River, NJ: Prentice Hall, ISBN   978-0-13-067389-3
  2. 1 2 Utkin, Vadim; Guldner, Jürgen; Shi, Jingxin (1999), Sliding Mode Control in Electromechanical Systems, Philadelphia, PA: Taylor & Francis, Inc., ISBN   978-0-7484-0116-1
  3. 1 2 Drakunov, S.V. (1983), "An adaptive quasioptimal filter with discontinuous parameters", Automation and Remote Control, 44 (9): 1167–1175
  4. 1 2 3 Bernat, J.; Stepien, S. (2015), "Multi modelling as new estimation schema for High Gain Observers", International Journal of Control, 88 (6): 1209–1222, Bibcode:2015IJC....88.1209B, doi:10.1080/00207179.2014.1000380, S2CID   8599596
  5. Krener, A.J.; Isidori, Alberto (1983), "Linearization by output injection and nonlinear observers", System and Control Letters, 3: 47–52, doi:10.1016/0167-6911(83)90037-3
  6. Krener, A.J.; Respondek, W. (1985), "Nonlinear observers with linearizable error dynamics", SIAM Journal on Control and Optimization, 23 (2): 197–216, doi:10.1137/0323016
  7. Gauthier, J.P.; Hammouri, H.; Othman, S. (1992), "A simple observer for nonlinear systems applications to bioreactors", IEEE Transactions on Automatic Control, 37 (6): 875–880, doi:10.1109/9.256352
  8. Hammouri, H.; Kinnaert, M. (1996), "A New Procedure for Time-Varying Linearization up to Output Injection", System and Control Letters, 28 (3): 151–157, doi:10.1016/0167-6911(96)00022-9
  9. Ciccarella, G.; Dalla Mora, M.; Germani, A. (1993), "A Luenberger-like observer for nonlinear systems", International Journal of Control, 57 (3): 537–556, doi:10.1080/00207179308934406
  10. Guo, Bao-Zhu; Zhao, Zhi-Liang (January 2011). "Extended State Observer for Nonlinear Systems with Uncertainty". IFAC Proceedings Volumes. 44 (1). International Federation of Automatic Control: 1855–1860. doi:10.3182/20110828-6-IT-1002.00399 . Retrieved 8 August 2023.
  11. "The Wayback Machine has not archived that URL" . Retrieved 8 August 2023.[ dead link ]
  12. Kumar, Sunil; Kumar Pal, Anil; Kamal, Shyam; Xiong, Xiaogang (19 May 2023). "Design of switched high-gain observer for nonlinear systems" . International Journal of Systems Science. 54 (7). Science Publishing Group: 1471–1483. Bibcode:2023IJSS...54.1471K. doi:10.1080/00207721.2023.2178863. S2CID   257145897 . Retrieved 8 August 2023.
  13. "Registration" . IEEE Xplore . Retrieved 8 August 2023.
  14. Drakunov, S.V. (1992). "Sliding-mode observers based on equivalent control method". [1992] Proceedings of the 31st IEEE Conference on Decision and Control. pp.  2368–2370. doi:10.1109/CDC.1992.371368. ISBN   978-0-7803-0872-5. S2CID   120072463.
  15. Narendra, K.S.; Han, Z. (August 2012). "A new approach to adaptive control using multiple models". International Journal of Adaptive Control and Signal Processing. 26 (8): 778–799. doi:10.1002/acs.2269. ISSN   1099-1115. S2CID   60482210.
  16. Combastel, C. (2003). "A state bounding observer based on zonotopes" (PDF). 2003 European Control Conference (ECC). pp. 2589–2594. doi:10.23919/ECC.2003.7085991. ISBN   978-3-9524173-7-9. S2CID   13790057.
  17. Rami, M. Ait; Cheng, C. H.; De Prada, C. (2008). "Tight robust interval observers: An LP approach" (PDF). 2008 47th IEEE Conference on Decision and Control. pp. 2967–2972. doi:10.1109/CDC.2008.4739280. ISBN   978-1-4244-3123-6. S2CID   288928.
  18. Efimov, D.; Raïssi, T. (2016). "Design of interval observers for uncertain dynamical systems". Automation and Remote Control. 77 (2): 191–225. doi:10.1134/S0005117916020016. hdl: 20.500.12210/25069 . S2CID   49322177.
  19. http://www.iaeng.org/publication/WCE2010/WCE2010_pp656-661.pdf [ bare URL PDF ]
  20. Hadj-Sadok, M.Z.; Gouzé, J.L. (2001). "Estimation of uncertain models of activated sludge processes with interval observers". Journal of Process Control. 11 (3): 299–310. doi:10.1016/S0959-1524(99)00074-8.
  21. Rami, Mustapha Ait; Tadeo, Fernando; Helmke, Uwe (2011). "Positive observers for linear positive systems, and their implications". International Journal of Control. 84 (4): 716–725. Bibcode:2011IJC....84..716A. doi:10.1080/00207179.2011.573000. S2CID   21211012.
General references