research27 min studyLesson 644 in Physics

Particle identification and misidentification

Connect detector likelihoods to efficiency, fake rates, and sample purity while accounting for population composition and calibration transport.

On this page

What you’ll understand

  • Define identification efficiency and misidentification probability as different conditional rates.
  • Calculate purity using the incident species composition.
  • Identify calibration and correlation assumptions behind a classifier working point.

A reconstructed track or energy cluster does not arrive with a reliable species label. Particle identification combines measurements such as ionization, shower shape, timing, Cherenkov angle, and penetration into muon detectors. Their distributions overlap, so classification is a statistical decision with both retained signal and misidentified background. A high efficiency does not by itself imply a pure selected sample. We will make the conditional probabilities explicit, calculate how base rates change purity, and examine the conditions under which a calibration sample represents the analysis population.

A species decision uses overlapping responses

Let x collect the measured identification variables. A likelihood ratio compares their joint density under an electron hypothesis with the density under a pion hypothesis. A cut on that ratio can define an electron-like sample. This is a response-based decision, not proof that each accepted object is an electron. The optimal threshold depends on the analysis objective, the relevant competing species, and their expected abundances; a working point optimized for one search need not suit another.

Combining several measurements requires their joint distribution or a validated approximation to it. Multiplying one-dimensional likelihoods while ignoring strong correlations can double-count information. A neural-network score can capture correlations but is not automatically a posterior species probability, even if its output lies between zero and one. Training class fractions, loss choice, calibration, and changes in detector conditions affect that interpretation. Validation should inspect the populations and kinematic region in which the score will be used.

Λ(x)=f(x∣e)f(x∣π),ϵe=P(pass∣e),fπ→e=P(pass∣π)\Lambda(x)=\frac{f(x\mid e)}{f(x\mid\pi)},\qquad \epsilon_e=P(\mathrm{pass}\mid e),\qquad f_{\pi\to e}=P(\mathrm{pass}\mid\pi)
The densities concern a specified kinematic and detector environment. Epsilon e is true-electron efficiency; f pi-to-e is a pion fake probability. Neither is the probability that an accepted object is an electron.↔ Scroll wide equations horizontally.

Purity also requires the incoming composition

Bayes’ rule converts pass probabilities into the composition after selection. If the preselection electron fraction is pi e and only electrons and pions are present, accepted electron weight is that fraction times electron efficiency. Accepted pion weight is the complementary fraction times the fake probability. Dividing electron weight by their sum gives purity. A small fake rate can still dominate when the background species is sufficiently more common.

The receiver-operating curve describes efficiency versus fake rate as the cut varies, but it does not specify an experiment’s base rates. Moving along that curve trades accepted signal against contamination. With multiple background species, the denominator contains a sum of their abundance-weighted pass rates. An analysis that changes its event selection can change those abundances without changing the classifier itself, so its selected purity may move even when detector-level efficiency and misidentification probabilities remain stable.

P(e∣pass)=πeϵeπeϵe+(1−πe)fπ→e,E[Npass]=ϵeNe+fπ→eNπP(e\mid\mathrm{pass})=\frac{\pi_e\epsilon_e}{\pi_e\epsilon_e+(1-\pi_e)f_{\pi\to e}},\qquad \mathbb E[N_{\mathrm{pass}}]=\epsilon_e N_e+f_{\pi\to e}N_\pi
The two-species expression assumes the rates apply to the stated population. All probabilities are dimensionless. The count relation gives expectations, so fractional expected fake counts are meaningful even though observed counts are integers.↔ Scroll wide equations horizontally.

Calibration must travel with its conditioning variables

Control decays with well-constrained species content allow identification efficiencies to be measured in data. Tag-and-probe methods constrain one object strongly and test another with a looser identification requirement, while fitting or subtracting residual backgrounds. Such samples must not impose the tested decision on every probe. Momentum, direction, track multiplicity, and detector period can all change response; reweighting or binning can help transfer measured rates to a different analysis population.

For an event containing two candidates, multiplying single-object efficiencies is valid only after conditioning on variables that make their decisions sufficiently independent, or after explicitly modeling their correlation. Shared occupancy, common calibration shifts, or overlapping showers can violate that assumption. Data-to-simulation scale factors also carry uncertainty and correlations between bins. Reporting only a global purity hides these dependencies; a usable measurement identifies the selection, true-species definition, calibration sample, and response uncertainties.

A small fake rate in a large background

A synthetic sample contains 100 true electrons and 900 true pions. A working point accepts 80 percent of electrons and misidentifies two percent of pions. Find the expected accepted counts and electron purity.

  1. The expected true-electron contribution is 100(0.80)=80100(0.80)=80. Efficiency is conditioned on being an electron before the identification cut.

  2. The expected pion contribution is 900(0.02)=18900(0.02)=18. A two-percent fake probability does not mean two percent of the final sample is fake.

  3. Total expected accepted count is 98, giving purity 80/98=40/49≃0.816380/98=40/49\simeq0.8163. The accepted sample is about 81.6 percent electrons despite its 80 percent true-electron efficiency.

The result

The expected selected sample has 80 electrons and 18 misidentified pions, with electron purity about 81.6 percent.

Explore the model

Interactive lab

Interactive lab · probability

A fake probability is conditional on species

Interpret success as a pion passing one identification decision. Reset, set Success probability p = 0.02 and Trials n = 20, and predict mean fake count 0.4. For a fresh run Reset, set p = 0.10 and n = 20, and predict mean 2.

A fake probability is conditional on speciesThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThe exact binomial bars assume independent identical pion trials. The instrument contains no electron fraction, mixed-species purity, classifier score, or correlated detector response; playback is not repeated measurement sampling.

Check your understanding

Which quantity is needed in addition to true-species pass rates to predict the purity of an accepted sample?

Try it yourself

A rarer synthetic population has 100 electrons and 9900 pions. A new working point has electron efficiency 0.90 and pion fake probability 0.01. Find expected electron purity and compare it with the electron efficiency.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Compute the two accepted populations before dividing; do not equate a fake probability with final contamination.

Compare with the solution

Accepted expectations are 100(0.90)=90100(0.90)=90 electrons and 9900(0.01)=999900(0.01)=99 pions. Purity is 90/189=10/21≃0.476290/189=10/21\simeq0.4762, below one half despite 90 percent electron efficiency and a one-percent pion fake rate. The preselection imbalance makes pions slightly more numerous after selection. This conclusion uses the specified rates and populations, not a universal property of this working point in every dataset.

Take it with you

  • Identification efficiency and fake probability condition on different true species.
  • Selected purity also depends on the incoming population through Bayes’ rule.
  • Calibration transfer and multiple-object efficiencies require explicit kinematic and correlation assumptions.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.