Detector response and likelihood inference
Forward-fold a physical spectrum through acceptance and migration, then construct a counting likelihood with explicit nuisance parameters.
On this page
The question for today
What you’ll understand
- Compute reconstructed yields from a response matrix whose efficiencies are explicit.
- Separate a likelihood, a likelihood ratio, and a posterior probability.
- Recognize calibration, nuisance correlations, and small-sample limitations in a search.
A theory predicts quantities at a specified physical level, while a detector records signals that must be reconstructed and selected. Acceptance, inefficiency, resolution, and background separate those two descriptions. A credible inference carries that separation into a generative model of the observed sample. We will forward-fold a small spectrum, construct its counting likelihood, and identify why a visually impressive excess or a large fitted signal strength is not yet a calibrated discovery claim.
Define which probabilities the response includes
Let be the expected produced signal count in true bin , and let be the probability that such an event passes selection and lands in reconstructed bin . With that convention a column sum can be below one because missed events are omitted. If a different response matrix is normalized only among selected events, multiply a separate efficiency instead. Applying both conventions together would double-count inefficiency and bias the inferred rate.
Detector response depends on the process and its unresolved kinematics, not only on the plotted axis. Calibrations use control data and simulation to constrain energy scales, resolutions, and identification efficiencies. Forward folding predicts measured bins directly, while unfolding estimates a specified physical-level distribution through an inverse problem. Regularization can stabilize that inverse problem but introduces correlations and possible model dependence; unfolded points are not automatically independent raw measurements.
The likelihood models data given parameters
For disjoint event-count bins, a common likelihood is a product of Poisson probabilities with expectations , multiplied by likelihood terms for auxiliary calibration and control measurements. Nuisance parameters encode quantities such as luminosity, background normalization, or energy response. A shared nuisance couples bins and channels; treating each appearance of a common calibration error as independent can artificially increase or decrease the claimed information. Write the generative assumptions before choosing an optimizer.
A likelihood is a function of parameters with the observed data fixed. It is not a normalized probability that a hypothesis is true. Profiling maximizes over nuisance parameters at each tested signal value, whereas marginalization integrates them with a stated prior in a Bayesian analysis. Both operations can be defensible, but they answer different questions. A plotted error bar should state its construction and coverage or posterior interpretation rather than inheriting meaning from the word "sigma" alone.
Calibrate the claim, not just the best fit
Large-sample likelihood approximations can simplify confidence intervals and significance calculations, but boundaries such as nonnegative signal strength and very sparse counts can invalidate a naive chi-squared rule. Pseudoexperiments or exact constructions can test coverage in the relevant regime. An auxiliary constraint also represents measured information, not a magical penalty that repairs a badly specified background shape. Validate predictions in control regions and examine goodness of fit alongside parameter estimates.
Searching many masses or selections changes the probability of finding an apparently unusual fluctuation somewhere. A local discrepancy and a global search significance answer different questions. Blinding and prespecifying procedures can reduce choices driven by a fluctuation, while independent data provide a stronger test. Report the fiducial definition, response assumptions, nuisance correlations, and treatment of repeated searches so another analyst can understand which physical claims the data actually support.
Work it through
Forward-fold two true bins
Let true signal expectations be (100,50), response columns be (0.7,0.1) and (0.2,0.6), and reconstructed background be (10,20). Compute reconstructed expectations at μ=1.
The response matrix is [[0.7,0.2],[0.1,0.6]]. Its column sums are both 0.8, so each true bin has 80% total selection efficiency.
The signal expectations are 0.7×100+0.2×50=80 in the first reconstructed bin and 0.1×100+0.6×50=40 in the second.
Add background after migration: ν=(80+10,40+20)=(90,60). The selected signal total 120 equals 80% of the 150 produced signal events.
The Poisson means are 90 and 60. Multiplying by an additional 0.8 efficiency would count the same loss twice.
The living notebook
Explore the model
Interactive lab · probability
Inspect efficiency fluctuations
Use n as a fixed number of candidate events and p as an independent, identical selection probability. The exact binomial bars show fluctuations in the number selected, with mean np and variance np(1−p). This lab models only that simplified efficiency step; it has no migration matrix, Poisson signal-plus-background fit, nuisance profiling, or significance calibration.
- Mean · np
- 5
- Variance · np(1−p)
- 2.5
- Total probability
- 1
These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forA sampling distribution follows from explicit repeated-data assumptions; it is not a probability that a theory is true.
Pause & reason
Check your understanding
Your turn
Try it yourself
For an illustrative single-bin model with reference selected signal s=20, known background b=10, and observed count n=50, find the unconstrained maximum-likelihood signal strength μ. Do not assign a discovery significance.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
The Poisson mean is 20μ+10, and its unconstrained maximum occurs when the mean equals n.
Compare with the solution
Set 20μ+10=50, giving μ̂=2. This is positive, so a μ≥0 constraint would not alter this estimate. It is a best fit within the stated model, not a probability that the signal exists. A significance needs a test definition, background assumptions, and a calibrated sampling distribution; uncertain background would also require additional nuisance information.
Keep the idea
Take it with you
- Define whether a response matrix already includes inefficiency before applying corrections.
- Likelihoods describe data given parameters; profiling and Bayesian marginalization are different constructions.
- Search claims need validated response, correlated uncertainties, and calibrated test-statistic behavior.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.