Instrument calibration and end-to-end transfer functions
Turn a connected-chain indication into a calibrated result with a documented uncertainty model and a stated domain of validity.
On this page
The question for today
What you’ll understand
- Determine a two-point offset and sensitivity for a declared affine calibration.
- Propagate independent uncertainties while identifying when covariance matters.
- State what traceability and a dynamic end-to-end calibration do and do not establish.
Calibration relates instrument indications to reference values under specified conditions. It does not simply make a device correct, and it does not remove the uncertainty of the reference or the fitted correction. A complete measurement identifies the measurand, the connected signal path, the calibration model, and the conditions under which that model is used. End-to-end calibration is especially valuable when sensor sensitivity, loading, gain, filtering, and digitization all contribute. The result belongs to the documented measurement, rather than to a brand name or the number of digits on a screen.
Estimate a relation and test its domain
An affine calibration uses an offset b and sensitivity K so that the output voltage is b+Kx. Two distinct known inputs determine these two parameters exactly in an idealized noiseless example. Real measurements require uncertainty in reference values and indications, repeated observations or other information about variability, and checks at additional inputs. Two points cannot establish that a nonlinear instrument is linear everywhere between or beyond them.
Applying a calibration means inverting the relation to infer x from a later voltage. The reference conditions matter: excitation, temperature, loading, range, and time since calibration can change b or K. A correction can be positive or negative. Its uncertainty describes incomplete knowledge of the needed correction, and is not the same thing as the error that the correction is intended to remove.
Uncertainty follows the measurement model
The first-order law of uncertainty propagation weights each input standard uncertainty by the derivative of the reported result with respect to that input. Independent contributions combine in variance. Correlated quantities require covariance terms, which can be important because offset and gain estimated from the same calibration data are often correlated. Treating them as independent without justification can overestimate or underestimate the final uncertainty.
NIST Technical Note 1297, in its 1994 edition, distinguishes standard uncertainty from expanded uncertainty and emphasizes corrections for recognized significant systematic effects. A coverage factor multiplies the combined standard uncertainty, but a chosen factor two does not automatically prove exactly ninety-five-percent coverage. Distributional assumptions, effective degrees of freedom, and the adequacy of the linear propagation model determine how an interval should be interpreted. The method and coverage statement should accompany the numerical result.
Traceability and dynamic response concern the complete result
NIST's metrological-traceability policy, consulted on 18 October 2026, treats traceability as a property of a measurement result linked to a reference through a documented unbroken calibration chain, with each link contributing uncertainty. A calibration label or a claim of NIST-traceable equipment is insufficient by itself to establish that an arbitrary later experiment has the required uncertainty. The user still needs a suitable chain, conditions, and uncertainty budget for the actual measurand.
A DC calibration does not determine phase lag, bandwidth, timing error, or channel crosstalk. A dynamic end-to-end test supplies known signals at the physical or electrical input and measures amplitude and phase through the connected chain. Record stimulus amplitude, source impedance, frequency, clock relation, and filtering. Large signals can violate linearity even when a small-signal transfer is accurate. Reporting these limits makes a calibrated result reproducible and separates a calculated model from a verified instrument performance claim.
Work it through
Calibrate an affine indication and invert it
A noiseless toy calibration gives V1=0.010 V at x1=0 units and V2=1.010 V at x2=100 units. A later indication is 0.510 V. Find the sensitivity and offset, infer x, and explain which behavior has not been established by these two points.
The voltage difference is 1.000 V over 100 units, so K=0.0100 V/unit. The first calibration point gives b=0.010 V.
Subtracting the offset from the later indication leaves 0.500 V. The inverse relation gives x=0.500/0.0100=50.0 units.
The two points determine the stipulated affine model. They do not test intervening nonlinearity, uncertainty, drift, or frequency response, so further characterization is needed before making those claims.
The affine sensitivity is 0.0100 V/unit, offset is 0.010 V, and the indicated input is 50.0 units within the declared toy model.
The living notebook
Explore the model
Interactive lab · matrix
Coupling can affect inversion even when the determinant is unchanged
For each fresh comparison, Reset and set BOTH Diagonal scale a=1 and Shear b. Compare b=0 and b=1. The selected final matrices have determinant 1 in both cases, but singular values (1,1) and approximately (1.61803,0.61803), respectively. Their singular-value ratios are 1 and 2.61803. Readouts describe the selected final matrix; geometry is identity at Reset and interpolates under Play/Step. This triangular map illustrates calibration coupling and conditioning, not a general calibration fit, uncertainty propagator, or measured instrument.
- Area scale · det A
- 1.4
- Singular values · σmax, σmin
- 1.597, 0.876
- Condition number · κ₂(A)
- 1.823
The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forAn unchanged determinant does not mean equal sensitivity to errors in every direction.
Pause & reason
Check your understanding
Your turn
Try it yourself
Use the affine inverse at x=50 units, with K=0.0100 V/unit and V−b=0.500 V. For this independent-input toy budget only, take standard uncertainties uV=0.002 V, ub=0.001 V, and uK=0.0001 V/unit. Compute the three contributions in input units, combined standard uncertainty, and expanded uncertainty for k=2. State the coverage limitation.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
The magnitudes of the derivatives are 1/|K| for V and b, and |V−b|/K² for K. Independence is an explicit toy assumption, not a generic property of fitted calibration parameters.
Compare with the solution
The contributions are 0.200 units from V, 0.100 units from b, and 0.500 units from K. Their combined standard uncertainty is units. With k=2, U≈1.09545 units. This is an expanded uncertainty with the stated factor, not an automatic exact ninety-five-percent interval. Correlations from a real calibration fit, nonlinearity, reference uncertainty, and drift must be assessed before adopting this toy budget for an experiment.
Keep the idea
Take it with you
- Calibration establishes a relation with conditions and uncertainties, rather than universal correctness.
- Covariance and coverage assumptions belong in uncertainty propagation.
- Traceability and end-to-end dynamic checks apply to the actual connected measurement.
Read further
Original sources and deeper explanations to follow at your own pace.
- NIST Technical Note 1297 (1994 edition), §5: Combined Standard Uncertainty — corrections and uncertainty propagation
- NIST Technical Note 1297 (1994 edition), §6: Expanded Uncertainty — coverage factors and interval interpretation
- NIST: Metrological Traceability, policy and FAQs, consulted 18 October 2026 — documented chains and uncertainty contributions
- MIT 6.071, Chaniotakis and Cory (2006): Introduction to Electronics, Signals and Measurement, PDF pp. 3–5 — calibration of nonlinear thermistor response
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.