core20 min studyLesson 13 in Mathematics

Eigenvalues and dynamics

Decompose repeated linear evolution into modes while recognizing the limits of diagonalization.

Before you begin
On this page

What you’ll understand

  • Interpret an eigenvector as an invariant direction.
  • Calculate discrete-time evolution using independent eigenmodes.
  • Distinguish eigenvalue stability from unsupported claims about every matrix.

Repeatedly multiplying a vector by a matrix can mix its coordinates at every step. An eigenvector identifies a direction that the transformation preserves, reducing its evolution to multiplication by one number. This is the beginning of mode analysis in mechanics, iterative algorithms, and quantum theory. The reward is a simple description of complicated motion; the responsibility is to check whether enough independent modes exist and whether time is discrete or continuous.

Directions that transform without mixing

An eigenvector is nonzero and returns parallel to itself after a linear map acts. Its eigenvalue gives the signed scale factor. A positive value preserves orientation, a negative value reverses it, and zero means that the direction disappears. The zero vector is excluded because it would satisfy the equation for every number and therefore identify no special direction. Eigenvectors may be multiplied by any nonzero scalar without changing their eigenvalue.

To find candidate eigenvalues of a square matrix, ask when A−λIA-\lambda I has a nontrivial nullspace. Its determinant must vanish. Solving that characteristic equation supplies eigenvalues; solving the corresponding homogeneous systems supplies eigenvectors. A real matrix can have complex eigenvalues, as a planar rotation demonstrates. Working over complex numbers broadens the available modes without turning the underlying real rotation into growth.

Av=λv,v≠0;det⁡(A−λI)=0Av=\lambda v,\quad v\ne0;\qquad \det(A-\lambda I)=0
A is square. The determinant condition identifies eigenvalues over the chosen scalar field; each associated eigenspace must still be found.↔ Scroll wide equations horizontally.

Repeated updates separate into modes

If a matrix has a full basis of eigenvectors, express the initial state in that basis. Each update multiplies one mode coefficient by its eigenvalue. After kk updates, the factor is the eigenvalue raised to the kkth power. Modes with magnitude less than one decay, those with magnitude greater than one grow, and negative values produce alternating signs. This conclusion concerns discrete updates, such as an iterative computation.

Continuous evolution follows a different rule. For the differential equation x˙=Ax\dot{x}=Ax, an eigenmode evolves with an exponential eλte^{\lambda t}, so decay is controlled by the real part of the eigenvalue rather than its magnitude. Confusing these criteria would classify stable numerical updates incorrectly. A negative continuous-time eigenvalue is damping; a discrete multiplier less than negative one produces increasing oscillations.

A=PΛP−1⟹Akx0=PΛkP−1x0A=P\Lambda P^{-1}\quad\Longrightarrow\quad A^k x_0=P\Lambda^kP^{-1}x_0
This formula assumes that the finite square matrix has a complete independent eigenbasis, P is invertible, and k is a nonnegative integer.↔ Scroll wide equations horizontally.

A powerful method with explicit limits

Repeated eigenvalues do not guarantee enough independent eigenvectors. The matrix with rows (1,1)(1,1) and (0,1)(0,1) has only one independent eigenvector, and its powers contain a term that grows with the step count despite both eigenvalues equaling one. Strictly inside the unit disk, every eigenvalue still guarantees eventual decay for a finite-dimensional discrete system, but nonorthogonal modes can create substantial temporary amplification.

Real symmetric matrices avoid the missing-basis problem: they admit an orthonormal eigenbasis and real eigenvalues. Their complex counterparts are Hermitian matrices. This structural fact later makes observable operators especially useful in finite-dimensional quantum mechanics, but eigenvalues alone do not provide the measurement probabilities. Likewise, a machine-learning optimizer's local Hessian may suggest mode-dependent behavior without proving global convergence of a nonlinear training process.

Follow a shared mode and a difference mode

Let A=(0.750.250.250.75)A=\begin{pmatrix}0.75&0.25\\0.25&0.75\end{pmatrix} and x0=(4,0)x_0=(4,0). Find x2x_2 without two full matrix multiplications.

  1. Check the two natural directions: A(1,1)=(1,1)A(1,1)=(1,1), while A(1,−1)=0.5(1,−1)A(1,-1)=0.5(1,-1). Their eigenvalues are 1 and 0.5.

  2. Decompose the initial state: (4,0)=2(1,1)+2(1,−1)(4,0)=2(1,1)+2(1,-1). The shared mode stays fixed and the difference mode is halved per update.

  3. After two updates, the difference coefficient is 2(0.5)2=0.52(0.5)^2=0.5. Reconstruct x2=2(1,1)+0.5(1,−1)=(2.5,1.5)x_2=2(1,1)+0.5(1,-1)=(2.5,1.5).

The result

The state approaches (2,2): total amount stays at four while the difference between coordinates decays. The unit eigenvalue prevents convergence to zero.

Explore the model

Interactive lab

Interactive lab · optimization

Turn a gradient step into a scalar eigenmode

Set the step size η\eta and initial coordinate x0x_0 for the exact quadratic-descent model xk=(1−η)kx0x_k=(1-\eta)^kx_0. Compare η=0.5\eta=0.5, 1.51.5, and a value above 22. This is one scalar mode, not an arbitrary matrix eigensolver; the multiplier 1−η1-\eta demonstrates the discrete stability criterion directly.

Turn a gradient step into a scalar eigenmodeGradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Current readings: Position x0: 2; Objective x²/2: 2; Iteration behavior: Stable step. All parameters are adjustable with the labeled controls below.−4−202402.174.356.528.7Parameter xf(x) = x²/2n = 0
ObjectiveDiscrete iterate
Position x0
2
Objective x²/2
2
Iteration behavior
Stable step
n = 0 · t = 0 s

Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThe same eigenvalue magnitude can describe smooth decay or alternating decay; crossing magnitude one changes stability.

Check your understanding

For the discrete scalar update xₖ₊₁=−0.5xₖ, what happens to a nonzero initial state?

Try it yourself

A matrix has independent eigenvectors v1,v2v_1,v_2 with eigenvalues 0.80.8 and −0.2-0.2. If x0=3v1+5v2x_0=3v_1+5v_2, find x3x_3.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Raise each eigenvalue to the third power before multiplying its initial coefficient.

Compare with the solution

The coefficients evolve separately: x3=3(0.8)3v1+5(−0.2)3v2=1.536v1−0.04v2x_3=3(0.8)^3v_1+5(-0.2)^3v_2=1.536v_1-0.04v_2. Both modes decay in magnitude, and the second changes sign after an odd number of steps.

Take it with you

  • Eigenvectors identify invariant directions of a square linear map.
  • Discrete powers and continuous exponentials have different stability criteria.
  • Diagonalization requires enough independent eigenvectors; symmetry guarantees an orthonormal eigenbasis.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.