Observability and minimal realizations
Recover internal information from output histories and identify the modes a transfer experiment cannot reveal.
On this page
The question for today
What you’ll understand
- Test observability using rank and the observation Gramian.
- Distinguish observability from detectability of unstable modes.
- Explain why a minimal finite-dimensional realization is both controllable and observable.
A sensor that reads only position can still reveal velocity through changes in position. Observability formalizes this use of time: two different initial states must produce different output histories when the known input contribution is removed. The issue is not whether every state is measured directly, but whether any internal ambiguity can remain hidden forever. Combining observability with controllability explains which state variables are essential to a transfer map and which describe internal behavior that the chosen input–output experiment never reveals.
Differentiate the output conceptually
For the unforced continuous-time LTI system, y(t)=Ce^{At}x₀. Its derivatives at zero involve Cx₀, CAx₀, CA²x₀ and higher powers. Cayley–Hamilton again truncates the structural test at n terms. Stacking these matrices gives the observability matrix, whose full column rank means no nonzero initial state produces identically zero output. If the input is known, subtract its forced response before applying this argument. Unknown disturbances cannot generally be removed the same way and require a different estimation model.
The derivative picture is a proof tool, not a recommendation to numerically differentiate noisy sensor data many times. The finite-horizon observation Gramian integrates e^{Aᵀt}CᵀCe^{At}; its quadratic form equals the output signal’s squared energy for a chosen initial state. It is positive definite exactly when the pair is observable. Small eigenvalues identify state combinations with weak output signatures. Such directions may be structurally observable but difficult to estimate under noise, much as a small reachability Gramian eigenvalue makes actuation expensive.
Unobservable is different from undetectable
The unobservable subspace is the kernel of the stacked observation matrix. It is A-invariant, so an initial ambiguity in that subspace remains invisible as it evolves. Detectability requires every mode confined to this invisible subspace to be strictly stable. Equivalently, there exists an observer injection L making A−LC Hurwitz. Observability permits arbitrary observer pole assignment, whereas detectability only asks whether some stable observer exists. An invisible stable state cannot be exactly reconstructed from output history, but its initial-error effect decays naturally.
The continuous-time PBH test says detectability holds when the stacked matrix with rows λI−A and C has full column rank for every complex λ with nonnegative real part. For observability, require the test at every eigenvalue, including stable ones. The boundary matters: an invisible eigenvalue at zero does not decay and therefore prevents detectability. In discrete time the corresponding forbidden region is |λ|≥1. This distinction mirrors controllability versus stabilizability and prevents unnecessarily rejecting a model that has harmless hidden stable modes.
Minimality concerns a specified transfer behavior
A finite-dimensional proper rational transfer matrix has a minimal state-space realization when no realization with fewer states produces the same zero-state input–output map. Such a realization is exactly one that is both controllable and observable. A Kalman decomposition separates reachable and unreachable directions and then the visible and invisible parts. Only the reachable-observable block is needed for the transfer map. Removing other blocks can preserve G while changing possible initial-state responses, so minimality is not a claim that discarded physical states never matter.
Any two minimal realizations of the same transfer matrix are related by an invertible similarity transformation. Their internal coordinates may differ, but their state dimension and pole structure agree. An unstable cancellation in a nonminimal realization can leave G stable while the internal system is unstable; checking the reduced transfer poles alone misses that issue. Conversely, a well-conditioned minimal realization can be more useful for estimation and numerical computation than a larger redundant model. The right reduction depends on the experiment and the requirement one intends to preserve.
Work it through
A stable transfer hides a growing state
Take A=diag(−1,2), B=(1,0)ᵀ, C=(1,0), D=0. Test observability, detectability and minimality.
The observation matrix has rows (1,0) and (−1,0), so rank is one. The second coordinate is unobservable.
Its hidden evolution is x₂(t)=exp(2t)x₂(0), which grows. Hence the model is not detectable; no output injection can repair that invisible unstable mode.
The transfer is G(s)=1/(s+1). It has a one-state minimal realization ẋ₁=−x₁+u,y=x₁, because the second state is both unreachable and unobservable in the zero-state experiment.
The transfer map is stable while the full two-state model is internally unstable. Reducing the transfer representation does not certify that a physical hidden state is safe.
The living notebook
Explore the model
Interactive lab · matrix
Weak signatures and inverse sensitivity
Pause and Reset, then set a=1,b=0 and predict condition number 1. For a fresh comparison Reset and set a=0.25,b=0; a unit input along the first coordinate produces an output of length 0.25, with condition number 4. This is a static invertible map, not an observation Gramian or a time-history reconstruction. It isolates the weak-signature geometry that makes noisy state recovery difficult.
- Area scale · det A
- 1.4
- Singular values · σmax, σmin
- 1.597, 0.876
- Condition number · κ₂(A)
- 1.823
The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forDistinguishing states in exact arithmetic does not guarantee equally accurate reconstruction in every direction.
Pause & reason
Check your understanding
Your turn
Try it yourself
For A=[[0,1],[0,0]] and C=(1,0), show observability and recover the initial state from unforced measurements y(0)=2 and y(1)=5.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Write the exact solution before treating the two measurements as two linear equations.
Compare with the solution
The stacked rows C and CA are (1,0) and (0,1), giving full rank two. Since x₂ is constant and x₁(t)=x₁(0)+t x₂(0), the output is y(t)=x₁(0)+t x₂(0). Thus x₁(0)=2 and x₂(0)=5−2=3. This exact recovery assumes the stated noiseless unforced model; with sensor noise, subtracting two samples can amplify error and a statistical estimator becomes appropriate.
Keep the idea
Take it with you
- Output history can reveal states not directly measured.
- Detectability allows unobservable modes only when they decay strictly.
- A minimal transfer realization is controllable and observable, but reduction may discard initial-state behavior.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.