research30 min studyLesson 89 in Physics

Detector response and likelihood inference

Forward-fold a physical spectrum through acceptance and migration, then construct a counting likelihood with explicit nuisance parameters.

On this page

What you’ll understand

  • Compute reconstructed yields from a response matrix whose efficiencies are explicit.
  • Separate a likelihood, a likelihood ratio, and a posterior probability.
  • Recognize calibration, nuisance correlations, and small-sample limitations in a search.

A theory predicts quantities at a specified physical level, while a detector records signals that must be reconstructed and selected. Acceptance, inefficiency, resolution, and background separate those two descriptions. A credible inference carries that separation into a generative model of the observed sample. We will forward-fold a small spectrum, construct its counting likelihood, and identify why a visually impressive excess or a large fitted signal strength is not yet a calibrated discovery claim.

Define which probabilities the response includes

Let tjt_j be the expected produced signal count in true bin jj, and let RijR_{ij} be the probability that such an event passes selection and lands in reconstructed bin ii. With that convention a column sum can be below one because missed events are omitted. If a different response matrix is normalized only among selected events, multiply a separate efficiency instead. Applying both conventions together would double-count inefficiency and bias the inferred rate.

Detector response depends on the process and its unresolved kinematics, not only on the plotted axis. Calibrations use control data and simulation to constrain energy scales, resolutions, and identification efficiencies. Forward folding predicts measured bins directly, while unfolding estimates a specified physical-level distribution through an inverse problem. Regularization can stabilize that inverse problem but introduces correlations and possible model dependence; unfolded points are not automatically independent raw measurements.

νi(μ,η)=μ∑jRij(η)tj(η)+bi(η),∑iRij≤1\nu_i(\mu,\eta)=\mu\sum_jR_{ij}(\eta)t_j(\eta)+b_i(\eta),\qquad \sum_iR_{ij}\le1
Here R includes both selection efficiency and migration, μ rescales the reference signal, η denotes nuisance parameters, and b is the expected reconstructed background.↔ Scroll wide equations horizontally.

The likelihood models data given parameters

For disjoint event-count bins, a common likelihood is a product of Poisson probabilities with expectations νi\nu_i, multiplied by likelihood terms for auxiliary calibration and control measurements. Nuisance parameters encode quantities such as luminosity, background normalization, or energy response. A shared nuisance couples bins and channels; treating each appearance of a common calibration error as independent can artificially increase or decrease the claimed information. Write the generative assumptions before choosing an optimizer.

A likelihood is a function of parameters with the observed data fixed. It is not a normalized probability that a hypothesis is true. Profiling maximizes over nuisance parameters at each tested signal value, whereas marginalization integrates them with a stated prior in a Bayesian analysis. Both operations can be defensible, but they answer different questions. A plotted error bar should state its construction and coverage or posterior interpretation rather than inheriting meaning from the word "sigma" alone.

L(μ,η)=∏iνi(μ,η)nie−νi(μ,η)ni! Laux(η),λ(μ)=L(μ,η^μ)L(μ^,η^)\mathcal L(\mu,\eta)=\prod_i\frac{\nu_i(\mu,\eta)^{n_i}e^{-\nu_i(\mu,\eta)}}{n_i!}\ \mathcal L_{\mathrm{aux}}(\eta),\qquad \lambda(\mu)=\frac{\mathcal L(\mu,\widehat\eta_\mu)}{\mathcal L(\widehat\mu,\widehat\eta)}
The profile likelihood ratio compares conditional and global maxima over the allowed parameter region. Its sampling distribution still needs justification or calibration.↔ Scroll wide equations horizontally.

Calibrate the claim, not just the best fit

Large-sample likelihood approximations can simplify confidence intervals and significance calculations, but boundaries such as nonnegative signal strength and very sparse counts can invalidate a naive chi-squared rule. Pseudoexperiments or exact constructions can test coverage in the relevant regime. An auxiliary constraint also represents measured information, not a magical penalty that repairs a badly specified background shape. Validate predictions in control regions and examine goodness of fit alongside parameter estimates.

Searching many masses or selections changes the probability of finding an apparently unusual fluctuation somewhere. A local discrepancy and a global search significance answer different questions. Blinding and prespecifying procedures can reduce choices driven by a fluctuation, while independent data provide a stronger test. Report the fiducial definition, response assumptions, nuisance correlations, and treatment of repeated searches so another analyst can understand which physical claims the data actually support.

Forward-fold two true bins

Let true signal expectations be (100,50), response columns be (0.7,0.1) and (0.2,0.6), and reconstructed background be (10,20). Compute reconstructed expectations at μ=1.

  1. The response matrix is [[0.7,0.2],[0.1,0.6]]. Its column sums are both 0.8, so each true bin has 80% total selection efficiency.

  2. The signal expectations are 0.7×100+0.2×50=80 in the first reconstructed bin and 0.1×100+0.6×50=40 in the second.

  3. Add background after migration: ν=(80+10,40+20)=(90,60). The selected signal total 120 equals 80% of the 150 produced signal events.

The result

The Poisson means are 90 and 60. Multiplying by an additional 0.8 efficiency would count the same loss twice.

Explore the model

Interactive lab

Interactive lab · probability

Inspect efficiency fluctuations

Use n as a fixed number of candidate events and p as an independent, identical selection probability. The exact binomial bars show fluctuations in the number selected, with mean np and variance np(1−p). This lab models only that simplified efficiency step; it has no migration matrix, Poisson signal-plus-background fit, nuisance profiling, or significance calibration.

Inspect efficiency fluctuationsThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forA sampling distribution follows from explicit repeated-data assumptions; it is not a probability that a theory is true.

Check your understanding

What does a profile likelihood ratio require before it becomes a calibrated significance?

Try it yourself

For an illustrative single-bin model with reference selected signal s=20, known background b=10, and observed count n=50, find the unconstrained maximum-likelihood signal strength μ. Do not assign a discovery significance.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The Poisson mean is 20μ+10, and its unconstrained maximum occurs when the mean equals n.

Compare with the solution

Set 20μ+10=50, giving μ̂=2. This is positive, so a μ≥0 constraint would not alter this estimate. It is a best fit within the stated model, not a probability that the signal exists. A significance needs a test definition, background assumptions, and a calibrated sampling distribution; uncertain background would also require additional nuisance information.

Take it with you

  • Define whether a response matrix already includes inefficiency before applying corrections.
  • Likelihoods describe data given parameters; profiling and Bayesian marginalization are different constructions.
  • Search claims need validated response, correlated uncertainties, and calibrated test-statistic behavior.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.