advanced29 min studyLesson 272 in Mathematics

Separating hyperplanes and support functions

Turn an outside point into a linear certificate and reconstruct a closed convex set from directional bounds.

On this page

What you’ll understand

  • Derive strict point-versus-set separation from a nearest point.
  • Compute and interpret a support function, including infinite values.
  • State the closedness assumptions behind reconstruction from supporting halfspaces.

A failed search for a feasible point is not yet a certificate of infeasibility. A separating direction can provide one: every feasible point has a bounded score along that direction, while the proposed point scores strictly higher. Support functions collect all these directional bounds into a single mathematical object. They connect geometry with optimization, because evaluating one means maximizing a linear functional over a set. We first work in finite-dimensional Euclidean space, where nearest points to nonempty closed convex sets make the separation argument concrete and checkable.

The nearest point supplies a normal

Let C be a nonempty closed convex subset of Rd\mathbb R^d, and let x lie outside C. A nearest point p exists: a minimizing sequence can be restricted to a bounded closed region, where compactness yields a convergent subsequence. Convexity gives uniqueness through the strict convexity of squared distance. For any z in C, move from p a small distance toward z. The squared distance to x cannot decrease, so its one-sided derivative is nonnegative. The resulting inner-product inequality identifies the normal direction a=x−p.

Every feasible z then has score at most the score of p, whereas x has an additional squared-distance margin. This strictly separates the outside point from the closed convex set, even if the set is unbounded. It is stronger than the general weak separation statement for two disjoint nonempty convex sets. Uniform positive-margin separation between arbitrary disjoint convex sets needs additional hypotheses. For example, the intervals (−1,0) and (0,1) are disjoint and admit a pointwise-strict separating level at zero, but there is no positive gap between their closures.

a=x−p≠0,⟨a,z⟩≤⟨a,p⟩<⟨a,x⟩,z∈Ca=x-p\ne0,\qquad \langle a,z\rangle\le\langle a,p\rangle<\langle a,x\rangle,\quad z\in C
The strict gap is ||x−p||². Closedness and convexity ensure a nearest point with the required variational inequality.↔ Scroll wide equations horizontally.

Store the furthest directional score

For a nonempty set C, its support function at a is the supremum of ⟨a,z⟩\langle a,z\rangle over z in C. It may be positive infinity when the set extends indefinitely in that direction. Taking the supremum makes the support function convex and positively homogeneous for nonnegative scaling. It does not require C itself to be convex. Indeed, replacing C by its closed convex hull leaves every support value unchanged. Linear measurements cannot distinguish a set from all of its convex mixtures and limit points.

For the Euclidean ball with center c and radius r, the support is ⟨a,c⟩+r∥a∥\langle a,c\rangle+r\|a\|. Cauchy–Schwarz gives the upper bound, and moving from c in direction a attains it when a is nonzero. For the nonnegative ray, a positive direction gives infinity while a nonpositive direction gives zero. Infinite values are meaningful geometric information, not a failed calculation. Translation shifts the support by a linear term, and scaling the set by a nonnegative factor scales its support wherever the extended-value operation is defined.

σC(a)=sup⁡z∈C⟨a,z⟩,σc+rB2(a)=⟨a,c⟩+r∥a∥2\sigma_C(a)=\sup_{z\in C}\langle a,z\rangle,\qquad \sigma_{c+rB_2}(a)=\langle a,c\rangle+r\|a\|_2
A support value is an upper directional bound. For a nonempty ball, the formula is finite and valid also at a=0.↔ Scroll wide equations horizontally.

Reconstruct geometry, with its hypotheses

A nonempty closed convex set equals the intersection of all halfspaces specified by its support function. One inclusion is immediate: every member satisfies every upper bound. For the converse, an outside point has the strict separator just constructed, so it violates at least one bound. Closedness matters because a halfspace intersection is closed. Convexity matters because a halfspace intersection is convex. Applied to an arbitrary nonempty set, the same construction returns its closed convex hull, potentially filling gaps and adding missing boundary points.

Supporting hyperplanes also describe boundary contact. For a closed convex set with nonempty interior, each boundary point admits a nonzero supporting normal; one can prove this by approaching from outside and taking a convergent sequence of normalized separating directions. The limit gives contact but need not give a positive margin. For a lower-dimensional set, one should distinguish support in the ambient space from support relative to its affine hull. A normal perpendicular to the whole affine hull is valid but says nothing about which relative boundary face is touched.

Certify that a point misses a disk

Take C={z:||z−(1,−1)||₂≤2} and x=(4,3). Produce an explicit strict separating inequality.

  1. The displacement from the center to x is (3,4), with length 5. The nearest point is p=(1,−1)+(2/5)(3,4)=(11/5,3/5).

  2. Use the simpler proportional normal a=(3,4). The disk support is 3(1)+4(−1)+232+42=93(1)+4(-1)+2\sqrt{3^2+4^2}=9.

  3. At x the score is 3·4+4·3=24. Thus every feasible z satisfies 3z₁+4z₂≤9, while x violates this bound by 15.

The result

The halfspace 3z₁+4z₂≤9 contains the entire disk and excludes x. The chosen a is proportional to x−p, so the contact point is precisely p.

Explore the model

Interactive lab

Interactive lab · vectors

Read a directional support score

Pause and Reset, then set angle=0° and magnitude=2. Predict x-projection 2, the support score for a=(1,0) at this circle point. Set both controls to angle=90°, magnitude=2 for a perpendicular point and predict score 0. Compare the x-projections. This is the boundary of a radius-two disk centered at the origin, represented by one vector at a time; it does not compute a separator for arbitrary sets.

Read a directional support scorePlayback traces a fixed vector and its projections. Angle and magnitude set the geometry; the moving marker does not change them. Current readings: x component: 1.393; y component: 0.975; Magnitude: 1.7. All parameters are adjustable with the labeled controls below.−7.46−3.7303.737.46−3.5−1.7501.753.5xyvvₓ = 1.39
Vectorx / y projectionsTrace marker
x component
1.393
y component
0.975
Magnitude
1.7
t = 0 s

Playback traces a fixed vector and its projections. Angle and magnitude set the geometry; the moving marker does not change them. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forDirectional support comes from maximizing a projection, rather than maximizing distance from the origin in every direction.

Check your understanding

Which set is determined by all support values of a nonempty bounded set S?

Try it yourself

For C=[−2,1]×[0,3], compute its support at a=(−1,2) and decide whether x=(−3,4) satisfies the resulting halfspace.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Maximize each coordinate contribution separately; the maximizing endpoint depends on the sign of the coefficient.

Compare with the solution

The first contribution −z₁ is maximized at z₁=−2, giving 2. The second contribution 2z₂ is maximized at z₂=3, giving 6. Thus σC(−1,2)=8\sigma_C(-1,2)=8, attained at (−2,3). The outside point has score −(−3)+2·4=11, so the inequality −z₁+2z₂≤8 excludes it. This one direction gives a sufficient certificate here, without constructing its nearest point.

Take it with you

  • An outside point and a nonempty closed convex set admit strict point-versus-set separation.
  • A support function can be infinite in unbounded directions.
  • All support inequalities reconstruct the closed convex hull, not an arbitrary original set.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.