Eigenvalues and dynamics
Decompose repeated linear evolution into modes while recognizing the limits of diagonalization.
On this page
The question for today
What you’ll understand
- Interpret an eigenvector as an invariant direction.
- Calculate discrete-time evolution using independent eigenmodes.
- Distinguish eigenvalue stability from unsupported claims about every matrix.
Repeatedly multiplying a vector by a matrix can mix its coordinates at every step. An eigenvector identifies a direction that the transformation preserves, reducing its evolution to multiplication by one number. This is the beginning of mode analysis in mechanics, iterative algorithms, and quantum theory. The reward is a simple description of complicated motion; the responsibility is to check whether enough independent modes exist and whether time is discrete or continuous.
Directions that transform without mixing
An eigenvector is nonzero and returns parallel to itself after a linear map acts. Its eigenvalue gives the signed scale factor. A positive value preserves orientation, a negative value reverses it, and zero means that the direction disappears. The zero vector is excluded because it would satisfy the equation for every number and therefore identify no special direction. Eigenvectors may be multiplied by any nonzero scalar without changing their eigenvalue.
To find candidate eigenvalues of a square matrix, ask when has a nontrivial nullspace. Its determinant must vanish. Solving that characteristic equation supplies eigenvalues; solving the corresponding homogeneous systems supplies eigenvectors. A real matrix can have complex eigenvalues, as a planar rotation demonstrates. Working over complex numbers broadens the available modes without turning the underlying real rotation into growth.
Repeated updates separate into modes
If a matrix has a full basis of eigenvectors, express the initial state in that basis. Each update multiplies one mode coefficient by its eigenvalue. After updates, the factor is the eigenvalue raised to the th power. Modes with magnitude less than one decay, those with magnitude greater than one grow, and negative values produce alternating signs. This conclusion concerns discrete updates, such as an iterative computation.
Continuous evolution follows a different rule. For the differential equation , an eigenmode evolves with an exponential , so decay is controlled by the real part of the eigenvalue rather than its magnitude. Confusing these criteria would classify stable numerical updates incorrectly. A negative continuous-time eigenvalue is damping; a discrete multiplier less than negative one produces increasing oscillations.
A powerful method with explicit limits
Repeated eigenvalues do not guarantee enough independent eigenvectors. The matrix with rows and has only one independent eigenvector, and its powers contain a term that grows with the step count despite both eigenvalues equaling one. Strictly inside the unit disk, every eigenvalue still guarantees eventual decay for a finite-dimensional discrete system, but nonorthogonal modes can create substantial temporary amplification.
Real symmetric matrices avoid the missing-basis problem: they admit an orthonormal eigenbasis and real eigenvalues. Their complex counterparts are Hermitian matrices. This structural fact later makes observable operators especially useful in finite-dimensional quantum mechanics, but eigenvalues alone do not provide the measurement probabilities. Likewise, a machine-learning optimizer's local Hessian may suggest mode-dependent behavior without proving global convergence of a nonlinear training process.
Work it through
Follow a shared mode and a difference mode
Let and . Find without two full matrix multiplications.
Check the two natural directions: , while . Their eigenvalues are 1 and 0.5.
Decompose the initial state: . The shared mode stays fixed and the difference mode is halved per update.
After two updates, the difference coefficient is . Reconstruct .
The state approaches (2,2): total amount stays at four while the difference between coordinates decays. The unit eigenvalue prevents convergence to zero.
The living notebook
Explore the model
Interactive lab · optimization
Turn a gradient step into a scalar eigenmode
Set the step size and initial coordinate for the exact quadratic-descent model . Compare , , and a value above . This is one scalar mode, not an arbitrary matrix eigensolver; the multiplier demonstrates the discrete stability criterion directly.
- Position x0
- 2
- Objective x²/2
- 2
- Iteration behavior
- Stable step
Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe same eigenvalue magnitude can describe smooth decay or alternating decay; crossing magnitude one changes stability.
Pause & reason
Check your understanding
Your turn
Try it yourself
A matrix has independent eigenvectors with eigenvalues and . If , find .
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Raise each eigenvalue to the third power before multiplying its initial coefficient.
Compare with the solution
The coefficients evolve separately: . Both modes decay in magnitude, and the second changes sign after an odd number of steps.
Keep the idea
Take it with you
- Eigenvectors identify invariant directions of a square linear map.
- Discrete powers and continuous exponentials have different stability criteria.
- Diagonalization requires enough independent eigenvectors; symmetry guarantees an orthonormal eigenbasis.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.