advanced31 min studyLesson 772 in Mathematics

Singular values and the Picard condition

Characterize the range of a compact operator using coefficient summability, including its orthogonality and nullspace requirements.

On this page

What you’ll understand

  • State the compact-Hilbert singular-system assumptions precisely.
  • Check both parts of the Picard range criterion.
  • Distinguish a minimum-norm inverse from a formal divergent coefficient expansion.

A singular expansion can suggest a solution by dividing every data coefficient by its singular value. Infinite dimensions add a crucial question: do the proposed object coefficients form a square-summable sequence? The Picard condition answers it. Here A:X→Y is a compact linear operator between real separable Hilbert spaces, with infinite-dimensional range. Finite-rank versions terminate, while the infinite sequence of positive singular values tends to zero and creates the instability of interest.

The singular vectors cover only the observable subspaces

A singular system consists of positive numbers σⱼ and orthonormal vectors vⱼ in X and uⱼ in Y, satisfying Avⱼ=σⱼuⱼ and A*uⱼ=σⱼvⱼ. The v vectors form a basis of the orthogonal complement of the nullspace of A; the u vectors span the closure of its range. They need not form bases of all of X or all of Y. Invisible object components and data orthogonal to the range must therefore be handled separately from the displayed singular coefficients.

Every object has a unique decomposition into an observable component and a null component. Applying A discards the latter and multiplies each observable coefficient by its σⱼ. Exact data in the range must be orthogonal to the nullspace of A*. However, that orthogonality only places data in the closure of the range, which may be larger than the range itself. The distinction is essential: arbitrarily accurate finite approximations to data do not ensure that a finite-norm exact preimage exists.

Avj=σjuj,A∗uj=σjvj,span⁡{vj}‾=N(A)⊥,span⁡{uj}‾=R(A)‾=N(A∗)⊥Av_j=\sigma_j u_j,\quad A^*u_j=\sigma_jv_j,\quad \overline{\operatorname{span}\{v_j\}}=\mathcal N(A)^\perp,\quad \overline{\operatorname{span}\{u_j\}}=\overline{\mathcal R(A)}=\mathcal N(A^*)^\perp
Only positive singular values are listed. For compact infinite-rank A they tend to zero; the nullspaces are not silently included in these bases.↔ Scroll wide equations horizontally.

Picard combines consistency with square summability

The range criterion says that y belongs to the range of A exactly when it is orthogonal to N(A*) and the sum of |⟨y,uⱼ⟩|²/σⱼ² is finite. Necessity follows by expanding any solution in the v basis and using Parseval. For sufficiency, that sum makes the proposed inverse series converge in X; boundedness of A permits passage through the limit and reconstructs y using its range-closure expansion. This proves existence rather than merely giving a formal expression.

The resulting solution lies in N(A) perpendicular and has minimum norm. All other exact solutions add a null vector, increasing the squared norm by an orthogonal term. For general data, the Moore–Penrose inverse is defined on R(A) plus its orthogonal complement: it discards the latter and inverts the range component when that component satisfies Picard. It is not defined as a finite-norm object on every datum in Y when the range is not closed. Calling it a universal bounded inverse would contradict compact ill-posedness.

y∈R(A)  ⟺  y⊥N(A∗) and ∑j≥1∣⟨y,uj⟩∣2σj2<∞,x†=∑j≥1⟨y,uj⟩σjvjy\in\mathcal R(A)\iff y\perp\mathcal N(A^*)\ \text{and}\ \sum_{j\ge1}\frac{|\langle y,u_j\rangle|^2}{\sigma_j^2}<\infty,\qquad x^\dagger=\sum_{j\ge1}\frac{\langle y,u_j\rangle}{\sigma_j}v_j
The series on the right converges in X precisely under the summability condition for consistent data. It selects the minimum-norm solution.↔ Scroll wide equations horizontally.

Noise can destroy the range condition

Small data norm does not control the weighted Picard sum because division by small singular values magnifies high-index components. Even a datum supported on one high mode can produce a large inverse. More general perturbations can make the divided coefficients fail square summability altogether. Spectral truncation avoids the infinite tail, but the number of retained modes then becomes a regularization choice. A finite-dimensional solve is not automatically a faithful approximation if that choice ignores the noise level.

The phrase discrete Picard condition often describes observed coefficients decaying faster than singular values over an initial range of indices before a noise plateau. It is a useful diagnostic, not the infinite-dimensional theorem itself. Real data can have correlated errors, and coefficients estimated from an uncertain forward operator may not display a clean plateau. The theorem gives a precise functional-space target; practical diagnostics require additional assumptions about measurement noise and discretization. A visual coefficient plot cannot prove exact membership in a nonclosed range.

A convergent datum with no square-summable preimage

On ℓ², let (Ax)ⱼ=xⱼ/j. Compare data yⱼ=1/j² with zⱼ=1/j^(3/2). Determine which has an ℓ² solution.

  1. The diagonal singular values are 1/j, with both singular bases the standard coordinate vectors. The nullspaces of A and A* are zero, so both data pass the range-closure orthogonality test.

  2. For y, division gives xⱼ=1/j. The Picard sum is Σ1/j², which converges, so this is a genuine ℓ² solution.

  3. For z, division gives xⱼ=1/√j. Although z itself is in ℓ² because Σ1/j³ converges, its Picard sum is Σ1/j, which diverges. Thus z lies in the range closure but not in the range.

The result

Square-summable observations need not have a square-summable preimage. The missing condition is weighted summability, not an overlooked algebraic division.

Explore the model

Interactive lab

Interactive lab · heat

See the rapid loss of high modes

Reset, set mode n=1 and diffusivity κ=1, then Step once to t=0.5; predict amplitude e^(−0.5). Compare a fresh Reset, n=3 and κ=1, then Step once; predict e^(−4.5). Inverting a heat observation at this fixed time would divide by these factors. The instrument displays the exact forward sine modes, not a noisy inverse or a numerical solver.

See the rapid loss of high modesThe exact periodic heat-equation mode is u(x,t) = exp(−κn²t) sin(nx), on [0,2π]. Playback advances physical time. The initial sine is shown separately, and the unnormalized L² norm is √π exp(−κn²t). This analytic instrument does not run a finite-difference solver or test discretization stability. Current readings: Current amplitude: 1; Spatial L² norm: 1.772; Decay rate · κn²: 3.6 /s. All parameters are adjustable with the labeled controls below.Periodic heat equation mode 3 at time 0: the amplitude is 1.0π/2π3π/22π−1−0.500.51x · periodic intervalTemperature perturbation uExact mode · n = 3
Current temperature modeInitial sineCurrent amplitude
Current amplitude
1
Spatial L² norm
1.772
Decay rate · κn²
3.6 /s
t = 0 s

The exact periodic heat-equation mode is u(x,t) = exp(−κn²t) sin(nx), on [0,2π]. Playback advances physical time. The initial sine is shown separately, and the unnormalized L² norm is √π exp(−κn²t). This analytic instrument does not run a finite-difference solver or test discretization stability. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forSmall high-mode forward amplitudes imply large gains in a formal backward reconstruction.

Check your understanding

Which conditions characterize y∈R(A) for the stated compact singular system?

Try it yourself

For the diagonal operator above, choose data perturbation e⁽ᴺ⁾=N⁻¹/²e_N. Find its data norm and its inverse norm as N tends to infinity.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The Nth singular value is 1/N, so only one coefficient needs to be divided.

Compare with the solution

The data norm is N⁻¹/², tending to zero. Its exact inverse is √N e_N, whose norm tends to infinity. Each individual perturbation is in the range and has finite support, so this example demonstrates unbounded inverse sensitivity without relying on a divergent inverse series for a single datum. It also shows why injectivity and dense range do not imply a continuous inverse on that range.

Take it with you

  • Singular bases cover observable subspaces and range closure.
  • Picard range membership needs orthogonality and weighted summability.
  • The minimum-norm generalized inverse can be unbounded and partially defined.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.