Keep client sampling, contribution bounds and dropout in one mechanism
Distinguish selected clients, surviving updates and honest secret noise contributors.
On this page
The question for today
What you’ll understand
- Compute an effective contribution probability only under explicit independence assumptions.
- Bound a whole client or user update before aggregation.
- Check distributed noise variance against the minimum honest contribution assumption.
Federated learning moves computation toward clients, but it does not by itself supply differential privacy. A client can contribute an update derived from many records, participate repeatedly and disappear before aggregation finishes. A user-level analysis must cover the whole bounded contribution, the client-selection mechanism and the actual surviving transcript. Availability, sampling and noise generation cannot be treated as unrelated implementation details.
Select and clip the protected client contribution
A client update can summarize several local optimization steps over many examples. Clipping that complete vector to C can bound one client’s add/remove contribution under the intended aggregation contract. Clipping individual local records instead is not automatically the same guarantee. If one person has multiple clients, a client-level claim also needs an identity or contribution-cap argument before it becomes user-level. Weighting updates by private record counts can change sensitivity; bound the weighted contribution and declare the public normalization rather than assuming an unweighted clipping proof still applies.
Selection probabilities must refer to the same protected unit. Uniform independent client selection is different from selecting available devices based on private behavior or favoring clients with large updates. The server can observe invitations, participation and dropout in some threat models; a hidden-sampling amplification theorem must not be applied to a transcript that reveals additional membership information without an analysis covering it. The original user-level language-model work and ordinary federated averaging address related training architectures, but their privacy claims and mechanisms are not interchangeable.
Dropout changes both signal and unknown noise
If survival is independent and data-independent, thinning can produce the displayed contribution probability. If poor connectivity, update magnitude or sensitive client behavior affects survival, the resulting participant set can be biased and the simpler privacy model may fail. Avoid replacing the configured sampling rate by an observed surviving fraction without proving that replacement valid. A public fixed divisor avoids some normalization ambiguity, but it does not fix an incorrect selection analysis or eliminate information in abort decisions.
When clients collectively generate Gaussian noise, the privacy-relevant variance is the part still unknown to the adversary. Noise from colluding clients that reveal their randomness cannot be counted as secret protection. Independent honest shares add variances, and dropout can reduce the number of remaining shares. A design can calibrate against a proven minimum of honest secret contributors and refuse or otherwise handle rounds outside that premise. Secure aggregation does not by itself enforce clipping, honest randomness or the lower bound on unknown noise.
Record the round actually executed
Log privacy-safe round metadata identifying the selection rule, clipping unit, public divisor, noise construction, permitted collusion, dropout policy and accountant step. The ledger must cover the observable abort and retry behavior, not merely completed model updates. Repeatedly asking the same small cohort for overlapping exact aggregates can expose differences even when each transport protocol hides individual messages. A statistical privacy analysis of released noisy outputs remains separate from cryptographic confidentiality of the aggregation process.
For a conditional survival-count analogy, Reset the probability lab and set both p=0.75 and n=20. Predict fifteen survivors on average and variance 3.75, conditional on twenty already-selected clients with independent survival. Play highlights exact binomial outcomes rather than contacting devices. This is not the unconditional selection-and-dropout distribution in the worked example, and it contains no user records, secret noise shares or privacy accountant. The distinction between conditioning on selected count and modeling the full round is the point of the activity.
Work it through
Separate unconditional participation from conditional survival
There are 100 public eligible client slots. Each client is independently selected with q=0.2 and independently survives with r=0.75, both data-independent. Assume the same independent rule across ten rounds. Compute unconditional survivor moments and a fixed client’s chance of contributing at least once.
One client contributes in a round with probability q r=0.2×0.75=0.15. The expected selected count is twenty, but the selected count itself is random under independent inclusion.
Unconditional survivors follow Binomial(100,0.15), with mean fifteen and variance 100×0.15×0.85=12.75. Conditional on exactly twenty selected clients, the survivor variance would instead be 20×0.75×0.25=3.75.
Across ten independent rounds, a fixed client has expected contribution count 10×0.15=1.5 and probability of at least one contribution 1−0.85¹⁰≈0.80313. These are participation calculations, not a composed privacy budget.
The conditional and unconditional counts have the same illustrated mean but different variances. Their probability model requires independent data-independent selection and survival; actual privacy still needs the clipped, noised mechanism and transcript analysis.
The living notebook
Explore the model
Interactive lab · probability
Condition on the selected cohort deliberately
Reset → set p=0.75 and n=20 → predict mean survivors 15 and variance 3.75 for twenty already-selected independent clients. Playback highlights exact outcomes.
- Mean · np
- 5
- Variance · np(1−p)
- 2.5
- Total probability
- 1
These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThis conditional binomial count model does not simulate selection, dropout protocols, Gaussian shares or user-level privacy.
Pause & reason
Check your understanding
Your turn
Try it yourself
A design needs coordinate noise SD at least six and assumes at least four independent honest secret shares. If every such share has SD three, what total SD follows with four shares and with only three? Separately, for q=0.25 and r=0.8, what is contribution probability?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Add variances, not standard deviations. The selection calculation uses the independent-thinning assumption separately.
Compare with the solution
Four shares give variance 4×9=36 and SD six. Three give variance 27 and SD √27≈5.196, below the target, so the four-share privacy premise cannot be retained without another valid mechanism or bound. Independent selection and survival give q r=0.2. None of these arithmetic checks establishes an epsilon budget on its own.
Keep the idea
Take it with you
- Client-level protection needs a bound on the complete client contribution.
- Observed dropout fractions cannot replace a sampling theorem without matching assumptions.
- Only surviving independent honest secret noise supports the claimed variance.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.