Maximal monotone operators and resolvents
Interpret implicit updates as resolvents and distinguish maximal graph extension from unusually large slopes.
On this page
The question for today
What you’ll understand
- Test monotonicity and explain graph maximality for set-valued operators.
- Derive firm nonexpansiveness from the resolvent inclusion.
- Compute a resolvent that is not the proximal map of a convex potential.
Subgradients have a consistency property: as the input moves, supporting slopes cannot turn against that movement in inner product. Monotone operator theory isolates this property from the existence of an underlying convex function. It therefore includes equilibrium relations and rotational couplings that are not gradients. A resolvent converts such a relation into a single-valued implicit update. The word maximal describes whether the graph can be enlarged while remaining monotone, not whether its values or slopes are numerically large. We work on a real Hilbert space, identifying vectors and continuous linear functionals through its inner product.
Relations, monotonicity and graph maximality
An operator A may assign a set of outputs to an input. Its graph contains all pairs (x,u) with u in A(x). It is monotone when the inner product of x−y with u−v is nonnegative for every two graph pairs. Empty output sets are allowed. Adding the two support inequalities proves that the subdifferential of a proper convex function is monotone. If the function is also lower semicontinuous on the Hilbert space, its subdifferential is maximal monotone. The maximality part is a substantive theorem, beyond the immediate two-inequality calculation.
Maximal means there is no strictly larger monotone graph containing the given graph. For example, the zero operator restricted to the open interval (0,1) is monotone but not maximal: adding (0,0), or extending zero to the whole line, preserves monotonicity. In contrast, the subdifferential of |x| includes the full vertical interval [−1,1] at zero. Omitting one of those admissible pairs would leave a monotone but nonmaximal graph. A steep single-valued derivative can be nonmaximal after a domain restriction, while a flat everywhere-defined zero operator is maximal.
Why the implicit relation is stable
Minty’s surjectivity theorem states that a monotone operator on a real Hilbert space is maximal monotone exactly when the range of I+λA is the whole space for a positive λ; equivalently this holds for every positive λ. Thus a maximal monotone operator has a resolvent output for every input. Monotonicity makes that output unique. Indeed, if z and w solve the relation for inputs x and y, substitute (x−z)/λ and (y−w)/λ into the monotonicity inequality and rearrange. This proves the firm nonexpansiveness bound displayed below.
Cauchy–Schwarz then gives ordinary nonexpansiveness: output distance cannot exceed input distance. This bound does not mean every repeated resolvent iteration converges to a zero when no zero exists. If A is the constant operator A(x)={1} on the line, its resolvent is x−λ and has no fixed point. When a zero does exist, fixed points of the resolvent are exactly those zeros. Convergence claims for repeated updates need their own assumptions; in infinite-dimensional Hilbert spaces one must also distinguish weak convergence from convergence in norm.
Not every monotone operator is a subgradient
On , let R(x₁,x₂)=(−x₂,x₁), a ninety-degree rotation. It is monotone because the inner product of every vector with its rotation is zero. The matrix I+λR has determinant 1+λ² and is invertible for every positive λ, so Minty’s theorem gives maximal monotonicity. However, R is not the gradient of a convex potential: its nonsymmetric Jacobian cannot be a Hessian. More generally, subdifferentials satisfy cyclic monotonicity, a stronger condition than the two-point monotonicity used here.
For a proper lower semicontinuous convex f, the resolvent of ∂f is precisely prox_{λf}, by the proximal optimality relation. This unifies projection, nonsmooth minimization and implicit monotone updates, while preserving the distinction between their mathematical classes. Explicit gradient descent has a step-size stability restriction even for a scalar quadratic; the implicit resolvent of its monotone gradient is nonexpansive for every positive parameter. This stability is not free computation: evaluating a general resolvent may itself require solving a difficult nonlinear subproblem.
Work it through
Resolve a rotational monotone coupling
For R(x₁,x₂)=(−x₂,x₁), compute J_R(2,0), using λ=1. Check the resolvent relation and its distance contraction against input zero.
Solve , giving z₁−z₂=2 and z₁+z₂=0. Hence z=(1,−1).
The residual is (2,0)−(1,−1)=(1,1), while R(1,−1)=(1,1). Thus x−z∈R(z), exactly the implicit relation.
The zero input maps to zero. The output squared distance is 2, and its inner product with the input displacement is , saturating the firm inequality. The output norm √2 is below the input norm 2.
The resolvent is a well-defined contracting linear map here even though the original monotone rotation is not the subgradient of a convex potential.
The living notebook
Explore the model
Interactive lab · optimization
Compare a scalar explicit path with an implicit factor
Pause and Reset, then set step size η=0.5 and initial x₀=2. Predict the displayed explicit sequence 2,1,0.5,0.25 as you Step. For this scalar quadratic alone, its factor 1−η=0.5 coincides with the resolvent factor 1/(1+λ) at λ=1. For a fresh run Reset and set η=2.5,x₀=2; predict alternating growth. The instrument remains explicit gradient descent, not a general resolvent solver or the rotational example.
- Position x0
- 2
- Objective x²/2
- 2
- Iteration behavior
- Stable step
Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forMatching scalar factors can illustrate an implicit contraction, but the explicit and implicit update rules have different stability ranges.
Pause & reason
Check your understanding
Your turn
Try it yourself
On R let A(x)={3x}. Find J_{2A}(7), verify its residual relation, and identify a convex function whose proximal map it is.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Write 7−z=2·3z. To find a potential, integrate the slope 3x.
Compare with the solution
The relation gives 7=7z, so z=1. The scaled residual (7−1)/2=3 belongs to A(1)={3}. The proper closed convex function f(x)=3x²/2 has ∂f(x)={3x}, so this resolvent equals prox_{2f}. For a general input v the map is v/7, which contracts every distance by 1/7 and is firmly nonexpansive. This example has a convex potential; the rotational worked example explains why that extra structure cannot be assumed for every maximal monotone operator.
Keep the idea
Take it with you
- Maximal monotonicity is a graph-extension property, not a large-slope condition.
- Minty supplies full resolvent domain; monotonicity supplies uniqueness and firm nonexpansiveness.
- Proximal maps are resolvents of subdifferentials, but maximal monotone operators form a larger class.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.