Geometric approximation and epsilon-nets
Specify the range family and the guarantee before choosing a small representative set.
On this page
The question for today
What you’ll understand
- Distinguish hitting heavy ranges from approximating their measures.
- State a finite-VC epsilon-net theorem with sampling and confidence assumptions.
- Compare range nets with objective-specific geometric coresets.
A small subset can represent a large point set in several incompatible senses. An epsilon-net hits every sufficiently heavy range; an epsilon-approximation estimates every range's population fraction; a geometric coreset preserves a specified optimization objective. None of these promises should be inferred from the word representative alone. We use a finite nonempty point set with its uniform probability measure, a fixed family of geometric ranges, and independent sampling with replacement when random samples are discussed. This finite setting avoids additional measurability issues needed for arbitrary infinite range spaces.
A net hits; an approximation estimates
A range space consists of a ground set and a family of allowed subsets, such as intersections with intervals, disks, or axis-aligned rectangles. A heavy range has population fraction at least the chosen positive threshold. An epsilon-net contains at least one point in every such range. Repeated sampled locations can be collapsed for this hitting property. They cannot be discarded from the empirical measure without changing its weights when the goal is a quantitative approximation.
An epsilon-approximation instead bounds the absolute difference between population and sample fractions for every range. It is a stronger kind of measurement, but threshold equality deserves care: an error bound of epsilon alone can allow a range of mass exactly epsilon to have sample mass zero. For example, an epsilon-over-two approximation certainly hits every range of mass at least epsilon. State the exact threshold or margin rather than silently treating a non-strict approximation inequality as a strict hitting guarantee.
VC dimension controls an entire range family
A set is shattered when the range family realizes all its subsets. The VC dimension is the maximum size of such a set, or infinity if no finite maximum exists. Intervals on a line have VC dimension two, while planar axis-aligned rectangles have dimension four. Finite dimension limits the number of distinct range traces on a sample. This combinatorial restriction permits a sample-size theorem independent of the original population size, despite the requirement to hit every heavy range simultaneously.
For a fixed range space of finite VC dimension v at least one, take epsilon and failure probability strictly between zero and one half. There is a universal constant such that an independent uniform sample with replacement of at least the displayed size is an epsilon-net with probability at least one minus the failure probability. The constant is not specified here, so the asymptotic expression is not a numerical sample-size recipe. The proof uses trace counting and a double-sampling argument; bounding the miss probability of one predetermined range is not the full uniform theorem.
Geometric objective approximation has another quantifier
A coreset is defined relative to an objective family. For directional width, a subset K is an epsilon-kernel when its width in every unit direction lies between one minus epsilon times the original width and the original width. The upper inequality follows from being a subset; the lower inequality must be proved uniformly over directions. A range-hitting guarantee does not establish this multiplicative width condition, just as retaining extreme points in a few directions does not automatically control all other directions.
Conversely, preserving widths does not guarantee accurate range counts. A few extreme points may retain the hull while missing nearly all population mass. The right summary therefore depends on the downstream question: coverage, counting, nearest-neighbor approximation, or an optimization objective. Include the metric, dimension, range family, weighting, and probability guarantee in the specification. A visual impression of even coverage or a successful test on a few ranges is not evidence for a simultaneous theorem over the entire family.
Work it through
A deterministic interval net and a random miss probability
Let , use closed intervals as ranges, and set . Show that is a net. Then calculate the probability that ten independent uniform draws miss one fixed range containing exactly three population points.
A heavy interval contains at least three points of P. Its intersection with P is a consecutive block of integers, and every block of three consecutive integers contains a multiple of three.
All such multiples in P belong to S, so every heavy interval is hit. This proves the net property for the whole interval family without randomization or an unspecified theorem constant.
A fixed three-point range has mass . Ten independent draws miss it with probability . This is a single-range probability, not the chance that the sample hits every heavy interval.
The deterministic certificate and the probabilistic calculation answer different questions. Neither establishes that the sample accurately estimates every interval's population fraction.
The living notebook
Explore the model
Interactive lab · probability
See the event of missing one fixed range
Pause/Reset and set BOTH controls to , trials . Predict expected hits , variance , and zero-hit probability . For a fresh comparison Pause/Reset and set BOTH to , : expected hits are , variance , and zero-hit probability is about . Changes retain the paused clock.
- Mean · np
- 5
- Variance · np(1−p)
- 2.5
- Total probability
- 1
These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe exact binomial bars describe hits in one predetermined range. They do not certify a net simultaneously over every range or construct a geometric coreset.
Pause & reason
Check your understanding
Your turn
Try it yourself
For and intervals, set and . Show S is an epsilon-net but is not an epsilon-approximation under equal weights on S.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Look for the longest consecutive block containing no selected point, then compare fractions on the interval from one to four.
Compare with the solution
The largest unselected gaps are three consecutive integers, such as five through seven. Every heavy interval contains at least four consecutive population points and therefore hits S, proving the net property. On range , the population fraction is , while the equally weighted sample fraction is . The absolute discrepancy is , so S fails the epsilon-approximation condition. Hitting all heavy ranges does not guarantee their fractions are estimated accurately.
Keep the idea
Take it with you
- A net guarantees intersection with every heavy range, rather than accurate counts.
- Finite VC dimension supports a uniform sampling guarantee with explicit confidence assumptions.
- A geometric coreset must specify and prove the objective family it preserves.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.