advanced32 min studyLesson 676 in Mathematics

Diffusion generators and martingale problems

Read local stochastic dynamics through test functions while keeping the operator domain explicit.

On this page

What you’ll understand

  • Derive the drift and covariance terms in a diffusion operator.
  • Formulate a martingale problem with a specified class of test functions.
  • Distinguish a differential expression from the domain of a semigroup generator.

An SDE describes trajectories using noise, whereas a generator describes how expected test functions change initially. The martingale problem connects these descriptions without requiring a prescribed Brownian driver. We consider continuous, nonexplosive time-homogeneous diffusions with deterministic coefficients. Smooth compactly supported tests avoid many integrability problems, but they do not remove the need to specify the state space, boundary behavior, and the operator domain when those become relevant.

Itô's formula identifies the local operator

For a diffusion with drift vector bb and noise matrix σ\sigma, the covariance matrix is a=σσTa=\sigma\sigma^{\mathsf T}. Apply Itô's formula to a twice continuously differentiable test function. Its finite-variation term is the gradient paired with the drift plus one half of the Hessian contracted with covariance. This defines the local differential expression LL. The number and coordinates of Brownian drivers do not enter separately once their resulting covariance has been formed.

Subtracting the integral of LfLf from the test function along the process leaves a local martingale. For compactly supported twice differentiable tests and locally bounded coefficients on the whole Euclidean space, the Brownian integrand is bounded, yielding a true martingale on finite horizons. Unbounded tests, such as a polynomial, require stopping and moment estimates before expectations are taken. The formal expression can be correct even when an unjustified expectation calculation based on it is not.

Lf=b⋅∇f+12∑i,jaij∂ijf,Mtf=f(Xt)−f(X0)−∫0tLf(Xs) dsLf=b\cdot\nabla f+\tfrac12\sum_{i,j}a_{ij}\partial_{ij}f,\qquad M_t^f=f(X_t)-f(X_0)-\int_0^tLf(X_s)\,ds
For an SDE solution, M is a local martingale; stronger integrability makes it a true martingale.↔ Scroll wide equations horizontally.

The domain is part of the generator

If the transition operators form a strongly continuous Feller semigroup on the continuous functions vanishing at infinity, its strong generator is defined by a uniform-norm limit at time zero. The domain consists of the functions for which that limit exists in the same function space. A smooth differential expression alone is not the whole operator. Whether a particular test belongs to the strong-generator domain depends on its behavior at infinity, regularity, and any boundary conditions.

The same interior expression on a half-line can accompany different processes. Killed Brownian motion at zero uses an absorbing Dirichlet condition on the interior state space, while reflecting Brownian motion has an appropriate Neumann derivative condition at the boundary. Reflection also introduces a boundary local-time term in a trajectory description. These are not interchangeable solutions of an unconstrained whole-line SDE simply because the second derivative in the interior is identical.

Af=lim⁡h↓0Phf−fhin the C0 uniform norm,f∈D(A)Af=\lim_{h\downarrow0}\frac{P_hf-f}{h}\quad\text{in the }C_0\text{ uniform norm},\qquad f\in D(A)
The limit and its domain define the strong generator; L is its differential expression on admissible smooth tests.↔ Scroll wide equations horizontally.

A law can be specified by martingales

The martingale problem specifies an initial distribution and asks for a probability law on continuous-path space such that MfM^f is a martingale for every test in a declared class, commonly smooth compactly supported functions. Existence and uniqueness of this law mean the martingale problem is well posed. An SDE solution supplies such a law through Itô's formula. Under suitable coefficient and covariance-factorization assumptions, the converse can be realized on an enlarged probability space, which is a weak rather than automatically strong construction.

For globally Lipschitz diffusion coefficients, the previous existence and uniqueness theory supplies a well-posed corresponding diffusion law. For rough coefficients, the martingale problem becomes a useful independent formulation, but well-posedness must still be proved. Merely writing LfLf does not guarantee a process exists or that its law is unique. The framework separates the local differential data from the probabilistic consistency and uniqueness questions that those data must satisfy.

A polynomial test outside the C-zero space

For dXt=−2Xtdt+3dWtdX_t=-2X_tdt+3dW_t with X0=2X_0=2, compute the local generator on f(x)=x2f(x)=x^2 and determine EXt2\mathbb EX_t^2. Explain how this use of a polynomial differs from a claim that it belongs to the strong generator on C0(R)C_0(\mathbb R).

  1. The drift term is (−2x)(2x)=−4x2(-2x)(2x)=-4x^2, and the curvature contribution is one half times nine times two, equal to nine. Thus the local expression gives Lf(x)=9−4x2Lf(x)=9-4x^2.

  2. The explicit mean-reverting Gaussian solution has finite moments on finite horizons. Stopping and then using these bounds justifies expectation, giving m′(t)=9−4m(t)m'(t)=9-4m(t) with m(0)=4m(0)=4.

  3. Solving the linear equation gives m(t)=9/4+(7/4)e−4tm(t)=9/4+(7/4)e^{-4t}. The polynomial does not vanish at infinity and hence is not an element of C0C_0, so this is an Itô or extended-generator computation, not membership in that strong-generator domain.

The result

The expected square tends to nine quarters. Its rigorous calculation uses moment control beyond the compactly supported martingale-problem tests.

Explore the model

Interactive lab

Interactive lab · heat

A generator eigenfunction decays predictably

Pause/Reset, then set both spatial mode to 2 and diffusivity to 0.5. For the periodic heat generator, predict eigenvalue −2 and amplitude exp(−1) after one Step, which advances time to 0.5. Reset and set both mode to 1 and diffusivity to 0.5; predict amplitude exp(−0.25) at the same time.

A generator eigenfunction decays predictablyThe exact periodic heat-equation mode is u(x,t) = exp(−κn²t) sin(nx), on [0,2π]. Playback advances physical time. The initial sine is shown separately, and the unnormalized L² norm is √π exp(−κn²t). This analytic instrument does not run a finite-difference solver or test discretization stability. Current readings: Current amplitude: 1; Spatial L² norm: 1.772; Decay rate · κn²: 3.6 /s. All parameters are adjustable with the labeled controls below.Periodic heat equation mode 3 at time 0: the amplitude is 1.0π/2π3π/22π−1−0.500.51x · periodic intervalTemperature perturbation uExact mode · n = 3
Current temperature modeInitial sineCurrent amplitude
Current amplitude
1
Spatial L² norm
1.772
Decay rate · κn²
3.6 /s
t = 0 s

The exact periodic heat-equation mode is u(x,t) = exp(−κn²t) sin(nx), on [0,2π]. Playback advances physical time. The initial sine is shown separately, and the unnormalized L² norm is √π exp(−κn²t). This analytic instrument does not run a finite-difference solver or test discretization stability. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThe analytic periodic heat mode demonstrates a generator acting on a sine eigenfunction. It computes an expectation-mode evolution, not individual noisy paths.

Check your understanding

Why is the domain needed in addition to a differential expression for a generator?

Try it yourself

For dXt=dt+2dWtdX_t=dt+2dW_t, compute the local expression on f(x)=cos⁡xf(x)=\cos x. Identify the two contributions and explain why treating this as an Itô test does not automatically place cosine in the strong-generator domain on C0(R)C_0(\mathbb R).

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Use the first and second derivatives, and then check whether the original function vanishes at infinity.

Compare with the solution

The drift contribution is −sin⁡x-\sin x and the curvature contribution is −2cos⁡x-2\cos x, so Lf=−sin⁡x−2cos⁡xLf=-\sin x-2\cos x. The derivatives and stochastic integrand are bounded, making the Itô martingale calculation valid on finite horizons. Cosine does not vanish at infinity, so it is not in C0(R)C_0(\mathbb R) and cannot belong to that space's strong-generator domain. A valid bounded test identity and a specific Banach-space domain assertion are different statements.

Take it with you

  • Covariance, rather than a chosen noise factorization, determines the second-order term.
  • An operator consists of its action together with its domain.
  • A martingale problem specifies a path law through a declared family of tests.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.