core24 min studyLesson 960 in Physics

Instrument calibration and end-to-end transfer functions

Turn a connected-chain indication into a calibrated result with a documented uncertainty model and a stated domain of validity.

On this page

What you’ll understand

  • Determine a two-point offset and sensitivity for a declared affine calibration.
  • Propagate independent uncertainties while identifying when covariance matters.
  • State what traceability and a dynamic end-to-end calibration do and do not establish.

Calibration relates instrument indications to reference values under specified conditions. It does not simply make a device correct, and it does not remove the uncertainty of the reference or the fitted correction. A complete measurement identifies the measurand, the connected signal path, the calibration model, and the conditions under which that model is used. End-to-end calibration is especially valuable when sensor sensitivity, loading, gain, filtering, and digitization all contribute. The result belongs to the documented measurement, rather than to a brand name or the number of digits on a screen.

Estimate a relation and test its domain

An affine calibration uses an offset b and sensitivity K so that the output voltage is b+Kx. Two distinct known inputs determine these two parameters exactly in an idealized noiseless example. Real measurements require uncertainty in reference values and indications, repeated observations or other information about variability, and checks at additional inputs. Two points cannot establish that a nonlinear instrument is linear everywhere between or beyond them.

Applying a calibration means inverting the relation to infer x from a later voltage. The reference conditions matter: excitation, temperature, loading, range, and time since calibration can change b or K. A correction can be positive or negative. Its uncertainty describes incomplete knowledge of the needed correction, and is not the same thing as the error that the correction is intended to remove.

V=b+Kx,K=V2−V1x2−x1,b=V1−Kx1,x=V−bKV=b+Kx,\qquad K=\frac{V_2-V_1}{x_2-x_1},\qquad b=V_1-Kx_1,\qquad x=\frac{V-b}{K}
V,b are voltages, x has the measurand’s units, and K has voltage per measurand unit. x1≠x2 and K≠0 are required for this affine inverse. These algebraic expressions do not by themselves quantify calibration uncertainty or establish linearity.↔ Scroll wide equations horizontally.

Uncertainty follows the measurement model

The first-order law of uncertainty propagation weights each input standard uncertainty by the derivative of the reported result with respect to that input. Independent contributions combine in variance. Correlated quantities require covariance terms, which can be important because offset and gain estimated from the same calibration data are often correlated. Treating them as independent without justification can overestimate or underestimate the final uncertainty.

NIST Technical Note 1297, in its 1994 edition, distinguishes standard uncertainty from expanded uncertainty and emphasizes corrections for recognized significant systematic effects. A coverage factor multiplies the combined standard uncertainty, but a chosen factor two does not automatically prove exactly ninety-five-percent coverage. Distributional assumptions, effective degrees of freedom, and the adequacy of the linear propagation model determine how an interval should be interpreted. The method and coverage statement should accompany the numerical result.

uc2(x)≃uV2+ub2K2+(V−b)2uK2K4,U=k uc(x),Hchain(f)=∏jHj(f)u_c^2(x)\simeq\frac{u_V^2+u_b^2}{K^2}+\frac{(V-b)^2u_K^2}{K^4},\qquad U=k\,u_c(x),\qquad H_{\mathrm{chain}}(f)=\prod_jH_j(f)
The displayed uncertainty sum assumes independent V,b,K and a valid first-order approximation; correlated estimates require additional derivative-weighted covariances. U is expanded uncertainty with stated coverage factor k. The transfer product separately assumes a linear time-invariant chain with loaded stage responses or negligible interstage interaction.↔ Scroll wide equations horizontally.

Traceability and dynamic response concern the complete result

NIST's metrological-traceability policy, consulted on 18 October 2026, treats traceability as a property of a measurement result linked to a reference through a documented unbroken calibration chain, with each link contributing uncertainty. A calibration label or a claim of NIST-traceable equipment is insufficient by itself to establish that an arbitrary later experiment has the required uncertainty. The user still needs a suitable chain, conditions, and uncertainty budget for the actual measurand.

A DC calibration does not determine phase lag, bandwidth, timing error, or channel crosstalk. A dynamic end-to-end test supplies known signals at the physical or electrical input and measures amplitude and phase through the connected chain. Record stimulus amplitude, source impedance, frequency, clock relation, and filtering. Large signals can violate linearity even when a small-signal transfer is accurate. Reporting these limits makes a calibrated result reproducible and separates a calculated model from a verified instrument performance claim.

Calibrate an affine indication and invert it

A noiseless toy calibration gives V1=0.010 V at x1=0 units and V2=1.010 V at x2=100 units. A later indication is 0.510 V. Find the sensitivity and offset, infer x, and explain which behavior has not been established by these two points.

  1. The voltage difference is 1.000 V over 100 units, so K=0.0100 V/unit. The first calibration point gives b=0.010 V.

  2. Subtracting the offset from the later indication leaves 0.500 V. The inverse relation gives x=0.500/0.0100=50.0 units.

  3. The two points determine the stipulated affine model. They do not test intervening nonlinearity, uncertainty, drift, or frequency response, so further characterization is needed before making those claims.

The result

The affine sensitivity is 0.0100 V/unit, offset is 0.010 V, and the indicated input is 50.0 units within the declared toy model.

Explore the model

Interactive lab

Interactive lab · matrix

Coupling can affect inversion even when the determinant is unchanged

For each fresh comparison, Reset and set BOTH Diagonal scale a=1 and Shear b. Compare b=0 and b=1. The selected final matrices have determinant 1 in both cases, but singular values (1,1) and approximately (1.61803,0.61803), respectively. Their singular-value ratios are 1 and 2.61803. Readouts describe the selected final matrix; geometry is identity at Reset and interpolates under Play/Step. This triangular map illustrates calibration coupling and conditioning, not a general calibration fit, uncertainty propagator, or measured instrument.

Coupling can affect inversion even when the determinant is unchangedThe selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Current readings: Area scale · det A: 1.4; Singular values · σmax, σmin: 1.597, 0.876; Condition number · κ₂(A): 1.823. All parameters are adjustable with the labeled controls below.Matrix A with first row 1.4, 0.6 and second row zero, one; display interpolates between identity and A while final determinant remains 1.4.−4−2024−2−1012x · equal geometric scaleyA = [ 1.4 0.6 ; 0 1 ]Display blend: 0% · final values below
Interpolated geometryOriginal unit squareSelected final transform
Area scale · det A
1.4
Singular values · σmax, σmin
1.597, 0.876
Condition number · κ₂(A)
1.823
t = 0 s

The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forAn unchanged determinant does not mean equal sensitivity to errors in every direction.

Check your understanding

What is metrological traceability a property of?

Try it yourself

Use the affine inverse at x=50 units, with K=0.0100 V/unit and V−b=0.500 V. For this independent-input toy budget only, take standard uncertainties uV=0.002 V, ub=0.001 V, and uK=0.0001 V/unit. Compute the three contributions in input units, combined standard uncertainty, and expanded uncertainty for k=2. State the coverage limitation.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The magnitudes of the derivatives are 1/|K| for V and b, and |V−b|/K² for K. Independence is an explicit toy assumption, not a generic property of fitted calibration parameters.

Compare with the solution

The contributions are 0.200 units from V, 0.100 units from b, and 0.500 units from K. Their combined standard uncertainty is uc=0.2002+0.1002+0.5002=0.30≃0.547723u_c=\sqrt{0.200^2+0.100^2+0.500^2}=\sqrt{0.30}\simeq0.547723 units. With k=2, U≈1.09545 units. This is an expanded uncertainty with the stated factor, not an automatic exact ninety-five-percent interval. Correlations from a real calibration fit, nonlinearity, reference uncertainty, and drift must be assessed before adopting this toy budget for an experiment.

Take it with you

  • Calibration establishes a relation with conditions and uncertainties, rather than universal correctness.
  • Covariance and coverage assumptions belong in uncertainty propagation.
  • Traceability and end-to-end dynamic checks apply to the actual connected measurement.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.