research32 min studyLesson 89 in Mathematics

Variational eigenvalue principles

Estimate low eigenvalues through trial spaces while tracking the assumptions behind upper bounds.

On this page

What you’ll understand

  • Interpret the Rayleigh quotient as a weighted average of spectral values.
  • State a min–max principle in a discrete semibounded setting.
  • Distinguish a Ritz upper bound from an error estimate or a lower bound.

An eigenvalue equation asks for both a special vector and its spectral value. A variational principle can estimate low eigenvalues without first solving that equation exactly. Trial functions give upper bounds, and carefully chosen subspaces organize excited states. The method powers finite-element calculations and quantum variational arguments. Its reliability depends on self-adjointness, lower boundedness, and the spectral setting: an attractive trial value alone is neither an existence proof for a discrete eigenstate nor an estimate of the remaining error.

The quotient records how a vector samples the spectrum

For a Hermitian matrix A and nonzero vector x, the Rayleigh quotient is x*Ax divided by x*x. Expanding x in an orthonormal eigenbasis expresses the quotient as an average of the eigenvalues with nonnegative weights summing to one. It lies between the smallest and largest eigenvalues. Equality at the smallest value occurs precisely for vectors in its eigenspace. This statement tolerates degeneracy: a unique preferred ground-state vector is not required.

For an unbounded self-adjoint operator bounded below, a closed quadratic form extends this idea to a form domain V that can be larger than D(A). For the Dirichlet Laplacian, the form integrates |u′|² and its domain is H1_0, while the operator domain additionally requires a second weak derivative in L2. Admissible variational trial functions must belong to the form domain. A discontinuous or boundary-violating trial function cannot be rescued by a small numerical quotient computed from an inconsistent discretization.

RA(x)=⟨x,Ax⟩∥x∥2=∑jλj∣cj∣2∑j∣cj∣2,x=∑jcjej≠0R_A(x)=\frac{\langle x,Ax\rangle}{\|x\|^2}=\frac{\sum_j\lambda_j|c_j|^2}{\sum_j|c_j|^2},\qquad x=\sum_j c_j e_j\ne0
The finite-dimensional identity uses an orthonormal eigenbasis of a self-adjoint matrix. In the form setting, replace the numerator by the closed quadratic form q[x].↔ Scroll wide equations horizontally.

Subspaces organize successive eigenvalues

Assume a self-adjoint operator is bounded below and has compact resolvent on an infinite-dimensional Hilbert space. Its eigenvalues can then be listed increasingly with multiplicity and tend to positive infinity. In this discrete setting the kth eigenvalue is the infimum, over all k-dimensional subspaces of the form domain, of the largest Rayleigh quotient in that subspace. Every k-dimensional space must contain a vector orthogonal to the first k−1 eigenvectors, preventing its worst quotient from falling below λ_k.

Choosing one finite trial space restricts the available subspaces and therefore gives Ritz values that are upper bounds for the corresponding exact eigenvalues. Enlarging nested conforming trial spaces cannot increase those Ritz values. Convergence to the true eigenvalues requires the trial spaces to approximate the form domain appropriately. Compactness is a convenient sufficient setting for a fully discrete sequence. With essential spectrum, related min–max statements need a different formulation and may reach a spectral threshold rather than produce another isolated eigenvalue.

λk=inf⁡S⊂Vdim⁡S=k sup⁡0≠x∈Sq[x]∥x∥2\lambda_k=\inf_{\substack{S\subset V\\\dim S=k}}\ \sup_{0\ne x\in S}\frac{q[x]}{\|x\|^2}
Here q is the closed semibounded form of a self-adjoint operator with compact resolvent, and V is its form domain. Eigenvalues are ordered with multiplicity.↔ Scroll wide equations horizontally.

An upper bound needs an accompanying error argument

A trial energy above the exact ground energy is guaranteed by the variational principle, but the principle alone does not tell how far above it lies. A small residual can add information. For a normalized vector x in D(A) and real μ, the spectral theorem gives distance from μ to the spectrum at most norm((A−μI)x). This locates some spectral value near μ; identifying which eigenvalue and bounding an eigenvector error additionally require spectral separation or other information.

Numerical quadrature, nonconforming spaces, and roundoff can alter the computed form or inner product, so an observed floating-point Ritz value is not automatically a rigorous mathematical upper bound. One needs controlled integration and arithmetic for certified bounds. The practical workflow is to check admissibility, state the min–max hypotheses, refine the trial space, and inspect residuals or independent bounds. The interactive finite sine family helps suggest trial shapes, but it computes neither the quadratic form nor a variational eigenvalue certificate.

dist⁡(μ,σ(A))≤∥(A−μI)x∥,∥x∥=1,x∈D(A),μ∈R\operatorname{dist}(\mu,\sigma(A))\le\|(A-\mu I)x\|,\qquad \|x\|=1,\quad x\in D(A),\quad\mu\in\mathbb R
Self-adjointness supplies this residual-to-spectrum estimate. It does not identify a unique eigenvalue or an eigenvector without additional gap information.↔ Scroll wide equations horizontally.

Two Ritz values from an imperfect subspace

For A=diag(1,4,9), restrict to the span of u=(1,1,0)/√2 and v=(0,0,1). Compute the two Ritz values and compare them with the first two exact eigenvalues.

  1. The vectors u and v are orthonormal. The projected matrix has entry uᵀAu=(1+4)/2=5/2, entry vᵀAv=9, and zero cross entries.

  2. The Ritz values are therefore 2.5 and 9. The exact first two eigenvalues are 1 and 4, and both upper-bound comparisons hold: 2.5≥1 and 9≥4.

  3. For the trial u and μ=2.5, the residual is (−1.5,1.5,0)/√2, whose norm is 1.5. The nearest exact spectral values 1 and 4 are both distance 1.5 away, showing why this residual alone cannot choose one.

The result

The trial space gives valid but loose upper bounds. A residual can locate nearby spectrum without identifying the target eigenvalue.

Explore the model

Interactive lab

Interactive lab · spectral

Choose admissible trial shapes before estimating energy

Pause at the initial time and change N and p in Σ sin(nx)/nᵖ. On (0,π), each such initial finite profile satisfies Dirichlet endpoints and is an admissible smooth trial function. Playback shifts phases and does not preserve those endpoints. The lab does not integrate derivative energy, minimize a quotient, or compute Ritz values.

Choose admissible trial shapes before estimating energyA finite sum of sin(nx − t)/nᵖ. Playback changes t; increasing the cutoff includes finer spatial scales. This is not a proof about a continuum limit or renormalization. Current readings: Sum at x = π/2: 0.867; Smallest wavelength: 2π / 5; Highest-mode coefficient: 0.2. All parameters are adjustable with the labeled controls below.01.573.144.716.28−2.56−1.2801.282.56x · radiansFinite sine sum
Finite sumHighest included mode
Sum at x = π/2
0.867
Smallest wavelength
2π / 5
Highest-mode coefficient
0.2
t = 0 s

A finite sum of sin(nx − t)/nᵖ. Playback changes t; increasing the cutoff includes finer spatial scales. This is not a proof about a continuum limit or renormalization. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forA candidate shape is only the start of a variational calculation; its domain and energy must both be checked.

Check your understanding

In a conforming finite-dimensional trial space, what does a Ritz value guarantee under the stated min–max assumptions?

Try it yourself

For A=diag(1,4,9), use the different trial space spanned by the first two coordinate vectors. What are its two Ritz values, and why do they improve the previous pair?

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Restrict A to the invariant coordinate plane.

Compare with the solution

The projected matrix is diag(1,4), giving exact Ritz values 1 and 4. This particular space already contains the first two eigenspaces. It is not a nested enlargement of the earlier two-dimensional space, so the improvement follows from the direct calculation, not from the nested-space monotonicity theorem. Enlarging either space to all three coordinates also recovers the exact spectrum.

Take it with you

  • The Rayleigh quotient averages spectral values with nonnegative weights.
  • Conforming min–max searches give upper bounds under explicit self-adjoint spectral assumptions.
  • Accuracy and eigenvector identification need more than a trial value alone.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.