advanced35 min studyLesson 930 in Mathematics

Geometric approximation and epsilon-nets

Specify the range family and the guarantee before choosing a small representative set.

On this page

What you’ll understand

  • Distinguish hitting heavy ranges from approximating their measures.
  • State a finite-VC epsilon-net theorem with sampling and confidence assumptions.
  • Compare range nets with objective-specific geometric coresets.

A small subset can represent a large point set in several incompatible senses. An epsilon-net hits every sufficiently heavy range; an epsilon-approximation estimates every range's population fraction; a geometric coreset preserves a specified optimization objective. None of these promises should be inferred from the word representative alone. We use a finite nonempty point set with its uniform probability measure, a fixed family of geometric ranges, and independent sampling with replacement when random samples are discussed. This finite setting avoids additional measurability issues needed for arbitrary infinite range spaces.

A net hits; an approximation estimates

A range space consists of a ground set and a family of allowed subsets, such as intersections with intervals, disks, or axis-aligned rectangles. A heavy range has population fraction at least the chosen positive threshold. An epsilon-net contains at least one point in every such range. Repeated sampled locations can be collapsed for this hitting property. They cannot be discarded from the empirical measure without changing its weights when the goal is a quantitative approximation.

An epsilon-approximation instead bounds the absolute difference between population and sample fractions for every range. It is a stronger kind of measurement, but threshold equality deserves care: an error bound of epsilon alone can allow a range of mass exactly epsilon to have sample mass zero. For example, an epsilon-over-two approximation certainly hits every range of mass at least epsilon. State the exact threshold or margin rather than silently treating a non-strict approximation inequality as a strict hitting guarantee.

μ(R)≥ε ⟹ S∩R≠∅,μ(R)=∣P∩R∣∣P∣.\mu(R)\geq\varepsilon\ \Longrightarrow\ S\cap R\neq\varnothing,\qquad \mu(R)=\frac{|P\cap R|}{|P|}.
This is the strong epsilon-net hitting condition for a subset of the finite population.↔ Scroll wide equations horizontally.

VC dimension controls an entire range family

A set is shattered when the range family realizes all its subsets. The VC dimension is the maximum size of such a set, or infinity if no finite maximum exists. Intervals on a line have VC dimension two, while planar axis-aligned rectangles have dimension four. Finite dimension limits the number of distinct range traces on a sample. This combinatorial restriction permits a sample-size theorem independent of the original population size, despite the requirement to hit every heavy range simultaneously.

For a fixed range space of finite VC dimension v at least one, take epsilon and failure probability strictly between zero and one half. There is a universal constant such that an independent uniform sample with replacement of at least the displayed size is an epsilon-net with probability at least one minus the failure probability. The constant is not specified here, so the asymptotic expression is not a numerical sample-size recipe. The proof uses trace counting and a double-sampling argument; bounding the miss probability of one predetermined range is not the full uniform theorem.

m≥Cε(vlog⁡vε+log⁡1δ)⟹P(S is an ε-net)≥1−δ.m\geq\frac{C}{\varepsilon}\left(v\log\frac{v}{\varepsilon}+\log\frac1\delta\right)\quad\Longrightarrow\quad P(S\text{ is an }\varepsilon\text{-net})\geq1-\delta.
For finite uniform populations, fixed finite VC dimension, and iid sampling with replacement, some universal C suffices.↔ Scroll wide equations horizontally.

Geometric objective approximation has another quantifier

A coreset is defined relative to an objective family. For directional width, a subset K is an epsilon-kernel when its width in every unit direction lies between one minus epsilon times the original width and the original width. The upper inequality follows from being a subset; the lower inequality must be proved uniformly over directions. A range-hitting guarantee does not establish this multiplicative width condition, just as retaining extreme points in a few directions does not automatically control all other directions.

Conversely, preserving widths does not guarantee accurate range counts. A few extreme points may retain the hull while missing nearly all population mass. The right summary therefore depends on the downstream question: coverage, counting, nearest-neighbor approximation, or an optimization objective. Include the metric, dimension, range family, weighting, and probability guarantee in the specification. A visual impression of even coverage or a successful test on a few ranges is not evidence for a simultaneous theorem over the entire family.

A deterministic interval net and a random miss probability

Let P={1,2,…,12}P=\{1,2,\ldots,12\}, use closed intervals as ranges, and set ε=1/4\varepsilon=1/4. Show that S={3,6,9,12}S=\{3,6,9,12\} is a net. Then calculate the probability that ten independent uniform draws miss one fixed range containing exactly three population points.

  1. A heavy interval contains at least three points of P. Its intersection with P is a consecutive block of integers, and every block of three consecutive integers contains a multiple of three.

  2. All such multiples in P belong to S, so every heavy interval is hit. This proves the net property for the whole interval family without randomization or an unspecified theorem constant.

  3. A fixed three-point range has mass 1/41/4. Ten independent draws miss it with probability (3/4)10≈0.0563135(3/4)^{10}\approx0.0563135. This is a single-range probability, not the chance that the sample hits every heavy interval.

The result

The deterministic certificate and the probabilistic calculation answer different questions. Neither establishes that the sample accurately estimates every interval's population fraction.

Explore the model

Interactive lab

Interactive lab · probability

See the event of missing one fixed range

Pause/Reset and set BOTH controls to p=0.25p=0.25, trials n=10n=10. Predict expected hits 2.52.5, variance 1.8751.875, and zero-hit probability 0.7510≈0.05631350.75^{10}\approx0.0563135. For a fresh comparison Pause/Reset and set BOTH to p=0.25p=0.25, n=20n=20: expected hits are 55, variance 3.753.75, and zero-hit probability is about 0.003171210.00317121. Changes retain the paused clock.

See the event of missing one fixed rangeThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThe exact binomial bars describe hits in one predetermined range. They do not certify a net simultaneously over every range or construct a geometric coreset.

Check your understanding

What additional ingredient turns a fixed-range miss calculation into a population-size-independent guarantee over all heavy ranges?

Try it yourself

For P={1,…,20}P=\{1,\ldots,20\} and intervals, set ε=0.2\varepsilon=0.2 and S={1,2,3,4,8,12,16,20}S=\{1,2,3,4,8,12,16,20\}. Show S is an epsilon-net but is not an epsilon-approximation under equal weights on S.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Look for the longest consecutive block containing no selected point, then compare fractions on the interval from one to four.

Compare with the solution

The largest unselected gaps are three consecutive integers, such as five through seven. Every heavy interval contains at least four consecutive population points and therefore hits S, proving the net property. On range [1,4][1,4], the population fraction is 4/20=0.24/20=0.2, while the equally weighted sample fraction is 4/8=0.54/8=0.5. The absolute discrepancy is 0.3>0.20.3>0.2, so S fails the epsilon-approximation condition. Hitting all heavy ranges does not guarantee their fractions are estimated accurately.

Take it with you

  • A net guarantees intersection with every heavy range, rather than accurate counts.
  • Finite VC dimension supports a uniform sampling guarantee with explicit confidence assumptions.
  • A geometric coreset must specify and prove the objective family it preserves.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.