advanced25 min studyLesson 403 in Engineering

Redundancy shares the environment unless the model says otherwise

Build a conditional common-cause mixture, distinguish marginal reliability from joint outage probability, and investigate shared failure domains and model uncertainty.

On this page

What you’ll understand

  • Use total probability to separate shared and local failure scenarios.
  • Calculate a joint failure probability without multiplying unconditional marginals.
  • Distinguish a simple common-cause model from a measured causal explanation.

Two replicas can have excellent individual uptime and still fail together. They may share power, software, credentials, operator action, traffic patterns, or an overloaded dependency. Knowing each marginal failure probability does not identify the joint probability. A conditional model makes one shared scenario explicit and shows why apparent independence can disappear when an environment variable is hidden from the analysis.

Condition on a named environment before multiplying

Let C be a specific common-cause event over the mission, such as a shared control dependency becoming unusable. Suppose C makes both replicas unavailable. Outside C, assume local replica failures are independent with a stated conditional probability q. This is a simplified mixture, not a universal physical law. It separates a high-impact shared scenario from ordinary local failures and uses independence only within the declared normal environment. The unconditional replicas then remain dependent because both respond to the same hidden environment.

Compute each marginal by including common-cause and normal scenarios, and compute joint failure with the same partition of possibilities. Multiplying the resulting marginal probabilities wrongly treats the common scenario as if it occurred independently for each replica. A service can therefore improve local component reliability while its joint outage approaches the common-cause floor. More replicas sharing that cause cannot drive modeled outage below the probability of the cause itself. Removing the cause or changing the conditional impact requires architecture and operational evidence, not just a new replica-count parameter.

P(F1∩F2)=c+(1−c)q2,P(Fi)=c+(1−c)qP(F_1\cap F_2)=c+(1-c)q^2,\qquad P(F_i)=c+(1-c)q
c=P(C), C forces both failures, and q is each replica's conditional failure probability given no C. Conditional local independence is assumed only outside C; all probabilities are dimensionless for the same mission.↔ Scroll wide equations horizontally.

Shared causes are richer than one correlation coefficient

A scalar correlation coefficient can summarize one aspect of dependence but does not fully describe a multi-replica outage distribution or its causes. Several different joint models can share similar marginals and correlations while assigning very different probabilities to rare all-replica failure. The mixture's all-or-nothing common cause is deliberately coarse. Real causes can affect a region, a software cohort, a fraction of disks, or repair capacity. Identify the relevant domains and conditional failure mechanisms before choosing a parameterization; do not retrofit a cause solely because a curve fits an incident count.

Diversity can reduce some shared modes while adding integration and operational risk. Different hardware with the same bad deployment still shares that deployment; different regions may still depend on one identity service. Conversely, failures occurring together can reflect common traffic or maintenance rather than direct causation between replicas. Record exposure, changes, and timeline evidence. The model should distinguish simultaneous observation from a demonstrated causal mechanism, and retain uncertainty when logs cannot resolve which shared scenario was active. Rare-event datasets often cannot estimate a tiny common-cause probability precisely.

P(F1∩⋯∩Fn)=∑zP(Z=z)P(F1∩⋯∩Fn∣Z=z)P(F_1\cap\cdots\cap F_n)=\sum_z P(Z=z)P(F_1\cap\cdots\cap F_n\mid Z=z)
This law of total probability uses mutually exclusive exhaustive environment states Z. Conditional independence can simplify an inner term only when justified; the formula does not require it and does not establish that the chosen states capture all causes.↔ Scroll wide equations horizontally.

Test what remains when local faults are removed

Compare scenarios that improve local reliability, remove a shared dependency, or reduce a cause's blast radius. Inspect whether the decision is stable across plausible common-cause probabilities. A reliability claim should name which causes were tested and which remain outside the model. Incident reviews and controlled fault injection can reveal missing coupling, but a test in one environment does not certify every future deployment. Preserve evidence for normal periods too, so a model does not learn only from visible outages while forgetting the exposure needed to interpret their frequency.

The binomial lab is an independence baseline, not a common-cause instrument. Reset, set BOTH failure probability p=0.02 and n=2, predict all-failure probability 0.0004, then Play or Step. Reset and re-set BOTH p=0.02 and n=3; predict 0.000008. Edits retain t and playback highlights exact counts. The bars have no shared environment variable and cannot display the mixture's common-cause floor. Use them to compute the normal-environment term, then add the shared scenario explicitly in the worked calculation rather than claiming extra independent trials model real fault-domain diversity.

A one-percent shared scenario dominates local redundancy

For one fictional mission, a shared cause occurs with probability c=0.01 and disables both replicas. Otherwise each replica fails independently with conditional probability q=0.02.

  1. Within the normal scenario, both fail with probability q²=0.0004. Weight by its probability 0.99 to obtain 0.000396.

  2. Add the disjoint common-cause scenario: joint failure is 0.01+0.000396=0.010396, or 1.0396 percent.

  3. Each marginal failure probability is 0.01+0.99×0.02=0.0298. Multiplying marginals gives 0.00088804, far below the correct joint probability because it discards the common environment.

The result

The modeled shared cause dominates the joint outage. The independence calculation is not conservative merely because both individual replicas look reliable.

Explore the model

Interactive lab

Interactive lab · probability

Compute the independent conditional baseline only

For EACH run Reset, set BOTH p and n, predict, then Play or Step. At failure p=0.02, n=2 gives all-failure mass 0.0004 and n=3 gives 0.000008. Edits retain t. This exact independent binomial model has no common cause, environment mixture, or fault-domain topology.

Compute the independent conditional baseline onlyThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forUse an independence model only for a justified conditional scenario; shared causes must be accounted for separately.

Check your understanding

Why is multiplying unconditional replica failure probabilities wrong in the stated common-cause mixture?

Try it yourself

In the same mixture form, c=0.005 and normal local failure probability q=0.1. Calculate joint failure for three replicas and the limiting floor as independent local failures become arbitrarily rare.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The common scenario and normal all-failure scenario are disjoint; only the latter is cubed.

Compare with the solution

Joint failure is 0.005+0.995×0.1³=0.005995. As local failure probability approaches zero, this tends to 0.005. The shared-cause probability remains a floor under the stated model until the architecture or the cause's impact changes.

Take it with you

  • Marginal reliability does not determine multi-replica outage probability.
  • Conditional independence must preserve the shared environment in total probability.
  • Fault-domain claims need mechanism evidence and uncertainty about missing causes.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.