Variational eigenvalue principles
Estimate low eigenvalues through trial spaces while tracking the assumptions behind upper bounds.
On this page
The question for today
What you’ll understand
- Interpret the Rayleigh quotient as a weighted average of spectral values.
- State a min–max principle in a discrete semibounded setting.
- Distinguish a Ritz upper bound from an error estimate or a lower bound.
An eigenvalue equation asks for both a special vector and its spectral value. A variational principle can estimate low eigenvalues without first solving that equation exactly. Trial functions give upper bounds, and carefully chosen subspaces organize excited states. The method powers finite-element calculations and quantum variational arguments. Its reliability depends on self-adjointness, lower boundedness, and the spectral setting: an attractive trial value alone is neither an existence proof for a discrete eigenstate nor an estimate of the remaining error.
The quotient records how a vector samples the spectrum
For a Hermitian matrix A and nonzero vector x, the Rayleigh quotient is x*Ax divided by x*x. Expanding x in an orthonormal eigenbasis expresses the quotient as an average of the eigenvalues with nonnegative weights summing to one. It lies between the smallest and largest eigenvalues. Equality at the smallest value occurs precisely for vectors in its eigenspace. This statement tolerates degeneracy: a unique preferred ground-state vector is not required.
For an unbounded self-adjoint operator bounded below, a closed quadratic form extends this idea to a form domain V that can be larger than D(A). For the Dirichlet Laplacian, the form integrates |u′|² and its domain is H1_0, while the operator domain additionally requires a second weak derivative in L2. Admissible variational trial functions must belong to the form domain. A discontinuous or boundary-violating trial function cannot be rescued by a small numerical quotient computed from an inconsistent discretization.
Subspaces organize successive eigenvalues
Assume a self-adjoint operator is bounded below and has compact resolvent on an infinite-dimensional Hilbert space. Its eigenvalues can then be listed increasingly with multiplicity and tend to positive infinity. In this discrete setting the kth eigenvalue is the infimum, over all k-dimensional subspaces of the form domain, of the largest Rayleigh quotient in that subspace. Every k-dimensional space must contain a vector orthogonal to the first k−1 eigenvectors, preventing its worst quotient from falling below λ_k.
Choosing one finite trial space restricts the available subspaces and therefore gives Ritz values that are upper bounds for the corresponding exact eigenvalues. Enlarging nested conforming trial spaces cannot increase those Ritz values. Convergence to the true eigenvalues requires the trial spaces to approximate the form domain appropriately. Compactness is a convenient sufficient setting for a fully discrete sequence. With essential spectrum, related min–max statements need a different formulation and may reach a spectral threshold rather than produce another isolated eigenvalue.
An upper bound needs an accompanying error argument
A trial energy above the exact ground energy is guaranteed by the variational principle, but the principle alone does not tell how far above it lies. A small residual can add information. For a normalized vector x in D(A) and real μ, the spectral theorem gives distance from μ to the spectrum at most norm((A−μI)x). This locates some spectral value near μ; identifying which eigenvalue and bounding an eigenvector error additionally require spectral separation or other information.
Numerical quadrature, nonconforming spaces, and roundoff can alter the computed form or inner product, so an observed floating-point Ritz value is not automatically a rigorous mathematical upper bound. One needs controlled integration and arithmetic for certified bounds. The practical workflow is to check admissibility, state the min–max hypotheses, refine the trial space, and inspect residuals or independent bounds. The interactive finite sine family helps suggest trial shapes, but it computes neither the quadratic form nor a variational eigenvalue certificate.
Work it through
Two Ritz values from an imperfect subspace
For A=diag(1,4,9), restrict to the span of u=(1,1,0)/√2 and v=(0,0,1). Compute the two Ritz values and compare them with the first two exact eigenvalues.
The vectors u and v are orthonormal. The projected matrix has entry uᵀAu=(1+4)/2=5/2, entry vᵀAv=9, and zero cross entries.
The Ritz values are therefore 2.5 and 9. The exact first two eigenvalues are 1 and 4, and both upper-bound comparisons hold: 2.5≥1 and 9≥4.
For the trial u and μ=2.5, the residual is (−1.5,1.5,0)/√2, whose norm is 1.5. The nearest exact spectral values 1 and 4 are both distance 1.5 away, showing why this residual alone cannot choose one.
The trial space gives valid but loose upper bounds. A residual can locate nearby spectrum without identifying the target eigenvalue.
The living notebook
Explore the model
Interactive lab · spectral
Choose admissible trial shapes before estimating energy
Pause at the initial time and change N and p in Σ sin(nx)/nᵖ. On (0,π), each such initial finite profile satisfies Dirichlet endpoints and is an admissible smooth trial function. Playback shifts phases and does not preserve those endpoints. The lab does not integrate derivative energy, minimize a quotient, or compute Ritz values.
- Sum at x = π/2
- 0.867
- Smallest wavelength
- 2π / 5
- Highest-mode coefficient
- 0.2
A finite sum of sin(nx − t)/nᵖ. Playback changes t; increasing the cutoff includes finer spatial scales. This is not a proof about a continuum limit or renormalization. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forA candidate shape is only the start of a variational calculation; its domain and energy must both be checked.
Pause & reason
Check your understanding
Your turn
Try it yourself
For A=diag(1,4,9), use the different trial space spanned by the first two coordinate vectors. What are its two Ritz values, and why do they improve the previous pair?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Restrict A to the invariant coordinate plane.
Compare with the solution
The projected matrix is diag(1,4), giving exact Ritz values 1 and 4. This particular space already contains the first two eigenspaces. It is not a nested enlargement of the earlier two-dimensional space, so the improvement follows from the direct calculation, not from the nested-space monotonicity theorem. Enlarging either space to all three coordinates also recovers the exact spectrum.
Keep the idea
Take it with you
- The Rayleigh quotient averages spectral values with nonnegative weights.
- Conforming min–max searches give upper bounds under explicit self-adjoint spectral assumptions.
- Accuracy and eigenvector identification need more than a trial value alone.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.