advanced30 min studyLesson 191 in Mathematics

Probability spaces and random elements

Build a probability model by specifying outcomes, measurable questions, and a normalized measure before introducing random observations.

Before you begin
On this page

What you’ll understand

  • Separate outcomes, events, and event probabilities in a measurable model.
  • Check measurability using inverse images of observable sets.
  • Explain why probability-zero events need not be impossible outcomes.

A probability model begins with the questions an experiment can answer. Suppose a device records only whether a real-valued signal is positive. The physical signal may take infinitely many values, but the recorded information partitions those values into two categories. A sigma-algebra describes which questions belong to the model, while a probability measure assigns their probabilities. Keeping these roles distinct prevents a common mistake: treating a plausible numerical distribution as a complete specification of every jointly observable quantity.

Outcomes and countably stable questions

The outcome space contains elementary possibilities; its elements are not themselves automatically events. Events are selected subsets in a sigma-algebra, which includes the whole space and is closed under complements and countable unions. These closures allow a sequence of yes-or-no questions to form a new legitimate question. Countability matters because limits of observations often use infinitely many operations. No requirement of closure under every uncountable union is imposed, and on uncountable spaces that stronger requirement would change the available measure theory.

A probability measure is nonnegative, assigns total mass one, and adds the masses of countably many pairwise disjoint events. From these assumptions follow monotonicity, the complement rule, and continuity under increasing unions. The last property explains why finite approximations can determine a limiting event. Specifying just finite additivity would not provide the same limit passage. In a finite experiment every subset can be measurable, but this convenient special case should not be mistaken for the definition of probability on general spaces.

P(Ω)=1,P ⁣(⋃j=1∞Aj)=∑j=1∞P(Aj)(Ai∩Aj=∅ for i≠j)\mathbb P(\Omega)=1,\qquad \mathbb P\!\left(\bigcup_{j=1}^{\infty}A_j\right)=\sum_{j=1}^{\infty}\mathbb P(A_j)\quad(A_i\cap A_j=\varnothing\text{ for }i\ne j)
Countable additivity applies to measurable, pairwise disjoint events; it is the axiom that supports approximation by increasing finite unions.↔ Scroll wide equations horizontally.

A random element transports observable questions

A random element is a measurable map from the outcome space to another measurable space. Its values might be real numbers, vectors, functions, or labels. Measurability means that every permitted question about its output pulls back to an event on the original space. It does not mean that the map is continuous, numerically smooth, or unpredictable. A deterministic constant is a valid random variable, and a discontinuous indicator is measurable whenever its defining event is measurable.

For a real-valued map, it suffices to verify that inverse images of half-lines are events, because these half-lines generate the Borel sigma-algebra and inverse images preserve the relevant set operations. A map that splits an atom of a coarse sigma-algebra cannot be measurable into the usual real Borel space. Here an atom means a nonempty measurable cell with no nontrivial measurable subset within it. The obstruction is informational: the output would reveal a distinction that the original model does not permit us to ask about.

X:(Ω,F)⟶(S,S) measurable⟺X−1(B)∈F for every B∈SX:(\Omega,\mathcal F)\longrightarrow(S,\mathcal S)\text{ measurable}\quad\Longleftrightarrow\quad X^{-1}(B)\in\mathcal F\ \text{for every }B\in\mathcal S
Measurability refers to the specified sigma-algebras on both spaces, not merely to the numerical formula for X.↔ Scroll wide equations horizontally.

Null events and completion

Consider the uniform probability measure on the unit interval. Every particular point has probability zero, yet an outcome is still some point. Probability zero therefore means negligible for the measure, rather than logically impossible. Likewise an almost-sure assertion may fail on a measurable null set. This distinction is essential when comparing random variables: two variables equal almost surely can differ as functions at particular outcomes without changing integrals of their integrable versions.

A probability space is complete when every subset of a measurable null set is measurable. Completing a space adds such subsets without changing probabilities of previously measurable events. Completeness is useful for describing modifications on negligible sets, but is an additional property rather than one of the three probability axioms. In particular the Borel sigma-algebra equipped with a measure need not already contain every subset of every null set. Always identify whether the discussion uses the original sigma-algebra or its completion.

P(X=Y)=1⟺P({ω:X(ω)≠Y(ω)})=0\mathbb P(X=Y)=1\quad\Longleftrightarrow\quad\mathbb P(\{\omega:X(\omega)\ne Y(\omega)\})=0
Almost-sure equality is a measure statement about a measurable exceptional set; it need not imply equality at every outcome.↔ Scroll wide equations horizontally.

A sensor that cannot distinguish two pairs

Let the outcome space be {a,b,c,d}, with measurable sets formed from the cells {a,b} and {c,d}. Assign the first cell probability 0.3. Can X(a)=X(b)=0 and X(c)=X(d)=2 be an observation? What about Y(a)=0 and Y(b)=1?

  1. The sigma-algebra consists of the empty set, the two cells, and the whole space. Normalization gives probability 0.7 to {c,d}; individual singleton probabilities are not specified in this model.

  2. Every inverse image under X is a union of complete cells, so X is measurable. The event X=0 is {a,b}, whose probability is 0.3.

  3. The inverse image of the Borel singleton {0} under Y contains a but not b, assuming the remaining Y values are 2. This set is not a union of the two cells, so Y is not measurable.

The result

X is a valid real random variable with masses 0.3 and 0.7. The proposed Y reveals unavailable information and is not a random variable on this measurable space.

Explore the model

Interactive lab

Interactive lab · probability

An exact finite probability space

Set n=2 and p=0.3. Before inspecting the bars, predict the probability of the event that the success count is either zero or two. Add those two bar masses: the event is a union of distinct observable outcomes. The controls generate an exact binomial law, not new random observations.

An exact finite probability spaceThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThe event has probability 0.49+0.09=0.58. This finite model illustrates event additivity; it does not display uncountable spaces or completion.

Check your understanding

On a uniform unit-interval probability space, what follows from the event U=1/2 having probability zero?

Try it yourself

On the same two-cell measurable space, define Z(a)=Z(b)=−1 and Z(c)=Z(d)=4. Find the event Z>0 and its probability. Explain whether changing Z only at a to 4 preserves measurability.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

List the inverse image of the positive half-line before and after the proposed change.

Compare with the solution

Initially {Z>0}={c,d}, a measurable cell of probability 0.7. After the change, the positive event is {a,c,d}. It splits {a,b}, so it is not one of the four measurable sets. The modified map is therefore not measurable. This is a change on an unavailable singleton, not an allowed modification on a measurable probability-zero event.

Take it with you

  • A probability space specifies both allowed events and their probabilities.
  • Measurable observations pull output questions back to allowed events.
  • Null events and impossible outcomes express different concepts.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.