research30 min studyLesson 878 in Physics

Cosmological likelihoods and parameter degeneracy

Construct correlated-data likelihoods with nuisance parameters, finite-covariance caveats, and a transparent calibration-floor example.

On this page

What you’ll understand

  • Evaluate a Gaussian residual quadratic with correlated errors.
  • Distinguish profiling, marginalizing, and fixing nuisance parameters.
  • Demonstrate how shared calibration limits the precision of an average.

A cosmological likelihood is a forward statement about the data expected from a model, including the instrument and selection that produced them. It is not simply a curve drawn through a published parameter contour. Different observables share calibration, foregrounds, sky modes, and theory uncertainties, so their errors can be correlated. We will build a small likelihood explicitly, show how nuisance calibration produces a precision floor, and distinguish limited data information from the additional assumptions introduced by priors or fixed parameters.

Predict the data vector and its distribution

Let d be a measured summary vector and m its predicted mean for cosmological parameters theta and nuisance parameters nu. Nuisance quantities can include detector calibration, galaxy bias, intrinsic alignments, foreground amplitudes, and redshift distributions. The residual is d minus m. A Gaussian data likelihood is useful when its sampling approximation is justified, but sparse counts, low-multipole powers, selection-truncated samples, or non-Gaussian summaries may require different distributions. Gaussianity of a plotted posterior is not a derivation of the data likelihood.

For a Gaussian vector, inverse covariance weights combinations of residuals rather than each entry separately. The determinant term supplies normalization and cannot be discarded when covariance depends on fitted parameters. If covariance is fixed throughout a fit, that term is a parameter-independent constant and does not move the maximum. The covariance must also match the estimator and survey window; errors for an ideal full-sky spectrum cannot simply be copied into a masked correlation analysis.

−2ln⁡L=(d−m)TC−1(d−m)+ln⁡det⁡C+nln⁡(2π),C=Cstat+Csyst-2\ln\mathcal L=(\boldsymbol d-\boldsymbol m)^{T}C^{-1}(\boldsymbol d-\boldsymbol m)+\ln\det C+n\ln(2\pi),\qquad C=C_{\mathrm{stat}}+C_{\mathrm{syst}}
The determinant is understood in a fixed data-unit convention, with parameter-independent normalization terms handled consistently. Adding covariance pieces assumes the corresponding errors have been represented without double counting and with any cross terms included where required.↔ Scroll wide equations horizontally.

A common calibration does not average away

Consider n measurements of the same mean, each with independent zero-mean noise of variance sigma squared, plus one common offset delta. Assign delta a zero-mean Gaussian calibration prior with variance tau squared. Integrating out that offset yields a covariance with tau squared in every entry. The sample mean then has independent-noise variance divided by n plus the unchanged calibration variance. This floor follows from a specified statistical model, not from labeling every unexplained discrepancy systematic.

Profiling chooses the best nuisance value for each cosmology, whereas marginalizing integrates nuisance values with their prior measure. Fixing the nuisance to its nominal value is a third operation and can yield overly narrow constraints. Under a linear Gaussian model some profiled and marginalized shapes coincide up to normalization, but that is not a general equivalence. Calibration information should enter either through an explicit nuisance prior or its properly marginalized covariance representation, avoiding duplicate use of the same information.

di=ϑ+δ+ϵi,ϵi∼N(0,σ2),δ∼N(0,τ2),C=σ2I+τ211T,Var⁡(d‾)=σ2n+τ2d_i=\vartheta+\delta+\epsilon_i,\quad\epsilon_i\sim\mathcal N(0,\sigma^2),\quad\delta\sim\mathcal N(0,\tau^2),\qquad C=\sigma^2I+\tau^2\boldsymbol1\boldsymbol1^T,\qquad\operatorname{Var}(\overline d)=\frac{\sigma^2}{n}+\tau^2
The independent errors are mutually independent and independent of the shared calibration offset. Theta here is a single mean parameter, not the full cosmological parameter vector. Sigma and tau have the same units as each measurement.↔ Scroll wide equations horizontally.

Degeneracies and estimated covariances need diagnostics

A degeneracy occurs when different parameter combinations produce nearly indistinguishable predicted data. Local derivatives identify weakly constrained directions, but a Fisher ellipse can miss curved ridges, boundaries, and multiple modes. Priors or complementary observations may close such directions; the resulting precision must then be attributed to that added information. A joint analysis needs cross-covariance for shared sky or calibration, and should check data-level residuals instead of relying solely on overlapping one-dimensional posterior intervals.

Covariance estimated from finitely many simulations is itself uncertain. For independent Gaussian simulation vectors and a specified covariance prior, integrating that uncertainty leads to a modified multivariate t likelihood, as derived by Sellentin and Heavens. This result is conditional on those assumptions; it does not make every simulated covariance exact. Convergence checks, simulation independence, model discrepancy, and posterior-predictive diagnostics remain necessary. A precise numerical sampler cannot repair an incorrect likelihood, an unmodeled selection, or a hidden reused datum.

Compute a calibration floor

Four synthetic measurements share one calibration offset with tau = 1 unit, and each has independent noise sigma = 2 units. Compute the variance and standard deviation of their mean. Compare with ignoring calibration, and then increase the sample to one hundred measurements with the same error model.

  1. For four measurements, the independent contribution is σ2/n=4/4=1\sigma^2/n=4/4=1 square unit. Shared calibration adds τ2=1\tau^2=1 square unit, so total variance is 2 and standard deviation is square root two.

  2. Ignoring the common offset would give standard deviation 2/4=12/\sqrt4=1 unit. It would confuse extra independent precision with knowledge of a common calibration that the data cannot separate from the mean.

  3. At n = 100, total variance becomes 4/100+1=1.044/100+1=1.04 square units, giving standard deviation about 1.020 units. As n grows without bound this uncertainty approaches one unit rather than zero.

The result

The four-point mean has variance 2 and standard deviation √2 units; one hundred points reduce it only to about 1.020 units because the shared calibration remains.

Explore the model

Interactive lab

Interactive lab · function

Compare local likelihood curvature

Treat y as an illustrative quadratic negative log likelihood. Reset, set Coefficient a = 0.5 and Position x = 1, and predict y = 0.5. For a fresh comparison Reset, set a = 1 and x = 1, and predict y = 1 and twice the tangent slope.

Compare local likelihood curvatureThis lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Current readings: y at chosen x: 0.608; Tangent slope · 2ax: 1.35; Signed area · ax³/3: 0.182. All parameters are adjustable with the labeled controls below.−2.4−1.201.22.4−9−4.504.59xy(x, ax²)
y = ax²TangentSigned integral
y at chosen x
0.608
Tangent slope · 2ax
1.35
Signed area · ax³/3
0.182
t = 0 s

This lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forOne parabola illustrates local curvature, not a multidimensional likelihood, nuisance marginalization, a calibrated confidence region, or estimated covariance uncertainty.

Check your understanding

When must the Gaussian likelihood’s log-determinant term be retained during parameter fitting?

Try it yourself

For two synthetic residuals use covariance C = [[2, 1], [1, 2]] in square units. Compute the residual quadratic for r = (1, −1) and for r = (1, 1). Explain why equal Euclidean lengths need not give equal likelihood penalties.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The inverse covariance is one third times [[2, −1], [−1, 2]]. Contrast and common-mode directions have different variances.

Compare with the solution

For the contrast vector, C−1(1,−1)T=(1,−1)TC^{-1}(1,-1)^T=(1,-1)^T, giving quadratic 2. For the common vector, C−1(1,1)T=(1/3,1/3)TC^{-1}(1,1)^T=(1/3,1/3)^T, giving quadratic 2/3. Both have ordinary squared length two, but the positively correlated covariance allows larger common displacements than differences. With the same fixed C, determinant terms are identical and do not alter this comparison.

Take it with you

  • A likelihood predicts selected measured data and their joint distribution.
  • Shared calibration creates a floor and must not be counted twice.
  • Priors, degeneracies, and covariance-estimation uncertainty affect the meaning of a parameter constraint.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.