First moments and existence certificates
Turn a count of obstructions into a positive probability of a valid discrete construction.
On this page
The question for today
What you’ll understand
- Choose a finite random construction whose outcomes have the required underlying structure.
- Use indicator expectations without assuming the indicators are independent.
- Distinguish an existence guarantee from a high probability statement or an efficient search algorithm.
An existence proof can succeed without displaying the object. The task is to design a random experiment whose outcomes are candidate objects, and show that the experiment sometimes avoids every obstruction. This changes a difficult global construction into a collection of local probability calculations. The crucial discipline is to distinguish randomness used to define the experiment from independence that a particular calculation actually requires.
Count the obstructions, not the successful objects
Suppose a finite probability space contains candidate colorings and let indicate that obstruction j occurs. Their sum X is a nonnegative integer. If every candidate were defective, X would always be at least one, so its expectation would also be at least one. Therefore an expected obstruction count strictly below one guarantees a defect-free outcome. This is an averaging argument; it does not require that different obstruction events be independent or even approximately independent.
Computing each marginal probability is usually much easier than counting all successful colorings. For a k-element set whose vertices receive independent fair red or blue colors, being monochromatic has probability . There are two acceptable monochromatic assignments among the equally likely assignments. When several sets overlap, their monochromatic events may interact strongly. Nevertheless their marginal probabilities add exactly when calculating the expected total count. The overlap becomes relevant for stronger probability estimates, not for linearity itself.
Keep the conclusion in the right direction
Markov’s inequality gives an upper bound on failure. Subtracting it from one gives a lower bound on success, useful when that lower bound is positive. An expected number of desirable features larger than one does not establish that a typical construction has such a feature. Rare outcomes with enormous counts can dominate the expectation. Conversely, for an integer score with expectation a, some outcome has score at least a, hence at least its ceiling. This is a different use of averaging from avoiding all bad features.
The strict inequality at the threshold matters. An expected obstruction count equal to one permits the obstruction count to be identically one, so it need not certify any valid outcome. If the expectation tends to zero along a sequence of models, the same argument does give success with probability tending to one. A fixed positive success lower bound proves existence and supports repeated randomized trials, but says nothing about how expensive it is to recognize a successful outcome.
Design the random experiment around the constraints
A random construction should satisfy the easy structural requirements automatically. To build a two-coloring, randomize colors rather than arbitrary subsets of an unrelated sample space. To search for a sparse subgraph, retain edges independently and count both the retained resources and unwanted patterns. Parameters can balance these expectations, although simultaneous resource and defect constraints may require a combined score, a concentration inequality, or a subsequent deletion step. Separate expectation statements do not automatically occur in the same outcome.
A useful audit records the sample space, each bad event, the event probability, and the resulting numerical inequality. It also records what has not been shown: an explicit coloring, a sharp threshold, or a practical deterministic algorithm. This prevents a probabilistic proof from promising more than its certificate contains. The worked calculation uses only a finite hypergraph, independent vertex colors, and a union bound; no assumptions about intersections between its edges are needed.
Work it through
Twelve constraints that can all be satisfied
A finite hypergraph has twelve edges, each containing exactly five distinct vertices. Show that some red-blue coloring makes every edge nonmonochromatic.
Color every vertex independently and fairly. For any one five-vertex edge, exactly two of its 32 assignments are monochromatic, giving bad-event probability .
Let X count monochromatic edges. Even if the edges overlap, linearity gives .
Markov gives , so the probability that all twelve constraints are satisfied is at least one quarter. A positive probability in this finite experiment guarantees a coloring.
A proper two-coloring exists, with success probability at least 1/4 under the stated experiment. This lower bound need not be exact.
The living notebook
Explore the model
Interactive lab · probability
Independent obstructions as a comparison model
Pause and Reset, then set success probability p = 0.05 and trials n = 12. Interpret success as an obstruction. Predict mean 0.6 and zero-count probability 0.95¹², approximately 0.5404; compare the leftmost bar with the first-moment lower bound 0.4. Reset and set both p = 0.05 and n = 20 for a second comparison. The instrument assumes independent indicators, whereas the hypergraph proof only needs their marginals; it does not display overlapping hyperedges.
- Mean · np
- 5
- Variance · np(1−p)
- 2.5
- Total probability
- 1
These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe zero-count bar can exceed the first-moment guarantee; independence is extra information, not a premise of linearity.
Pause & reason
Check your understanding
Your turn
Try it yourself
A hypergraph has seven four-vertex edges. Give a numerical success guarantee for independent fair vertex colors. Explain what changes when there are eight such edges.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Count the two monochromatic assignments on one edge, then sum their probabilities. Do not multiply probabilities for different edges.
Compare with the solution
Each edge is monochromatic with probability . For seven edges the expected bad count is , so the probability of a proper coloring is at least . With eight edges the same computation gives expectation one and a success lower bound of zero. It is inconclusive, not a proof that proper coloring is impossible. The actual intersection pattern or a stronger method might still establish existence. The seven-edge conclusion remains valid for arbitrary intersections because none of the expectation or union-bound steps required independent edge events.
Keep the idea
Take it with you
- Linearity of expectation survives dependence between obstruction indicators.
- An expected integer obstruction count below one certifies a valid outcome.
- Existence, typical success, efficient search, and efficient certification are separate claims.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.