Cosmological likelihoods and parameter degeneracy
Construct correlated-data likelihoods with nuisance parameters, finite-covariance caveats, and a transparent calibration-floor example.
On this page
The question for today
What you’ll understand
- Evaluate a Gaussian residual quadratic with correlated errors.
- Distinguish profiling, marginalizing, and fixing nuisance parameters.
- Demonstrate how shared calibration limits the precision of an average.
A cosmological likelihood is a forward statement about the data expected from a model, including the instrument and selection that produced them. It is not simply a curve drawn through a published parameter contour. Different observables share calibration, foregrounds, sky modes, and theory uncertainties, so their errors can be correlated. We will build a small likelihood explicitly, show how nuisance calibration produces a precision floor, and distinguish limited data information from the additional assumptions introduced by priors or fixed parameters.
Predict the data vector and its distribution
Let d be a measured summary vector and m its predicted mean for cosmological parameters theta and nuisance parameters nu. Nuisance quantities can include detector calibration, galaxy bias, intrinsic alignments, foreground amplitudes, and redshift distributions. The residual is d minus m. A Gaussian data likelihood is useful when its sampling approximation is justified, but sparse counts, low-multipole powers, selection-truncated samples, or non-Gaussian summaries may require different distributions. Gaussianity of a plotted posterior is not a derivation of the data likelihood.
For a Gaussian vector, inverse covariance weights combinations of residuals rather than each entry separately. The determinant term supplies normalization and cannot be discarded when covariance depends on fitted parameters. If covariance is fixed throughout a fit, that term is a parameter-independent constant and does not move the maximum. The covariance must also match the estimator and survey window; errors for an ideal full-sky spectrum cannot simply be copied into a masked correlation analysis.
A common calibration does not average away
Consider n measurements of the same mean, each with independent zero-mean noise of variance sigma squared, plus one common offset delta. Assign delta a zero-mean Gaussian calibration prior with variance tau squared. Integrating out that offset yields a covariance with tau squared in every entry. The sample mean then has independent-noise variance divided by n plus the unchanged calibration variance. This floor follows from a specified statistical model, not from labeling every unexplained discrepancy systematic.
Profiling chooses the best nuisance value for each cosmology, whereas marginalizing integrates nuisance values with their prior measure. Fixing the nuisance to its nominal value is a third operation and can yield overly narrow constraints. Under a linear Gaussian model some profiled and marginalized shapes coincide up to normalization, but that is not a general equivalence. Calibration information should enter either through an explicit nuisance prior or its properly marginalized covariance representation, avoiding duplicate use of the same information.
Degeneracies and estimated covariances need diagnostics
A degeneracy occurs when different parameter combinations produce nearly indistinguishable predicted data. Local derivatives identify weakly constrained directions, but a Fisher ellipse can miss curved ridges, boundaries, and multiple modes. Priors or complementary observations may close such directions; the resulting precision must then be attributed to that added information. A joint analysis needs cross-covariance for shared sky or calibration, and should check data-level residuals instead of relying solely on overlapping one-dimensional posterior intervals.
Covariance estimated from finitely many simulations is itself uncertain. For independent Gaussian simulation vectors and a specified covariance prior, integrating that uncertainty leads to a modified multivariate t likelihood, as derived by Sellentin and Heavens. This result is conditional on those assumptions; it does not make every simulated covariance exact. Convergence checks, simulation independence, model discrepancy, and posterior-predictive diagnostics remain necessary. A precise numerical sampler cannot repair an incorrect likelihood, an unmodeled selection, or a hidden reused datum.
Work it through
Compute a calibration floor
Four synthetic measurements share one calibration offset with tau = 1 unit, and each has independent noise sigma = 2 units. Compute the variance and standard deviation of their mean. Compare with ignoring calibration, and then increase the sample to one hundred measurements with the same error model.
For four measurements, the independent contribution is square unit. Shared calibration adds square unit, so total variance is 2 and standard deviation is square root two.
Ignoring the common offset would give standard deviation unit. It would confuse extra independent precision with knowledge of a common calibration that the data cannot separate from the mean.
At n = 100, total variance becomes square units, giving standard deviation about 1.020 units. As n grows without bound this uncertainty approaches one unit rather than zero.
The four-point mean has variance 2 and standard deviation √2 units; one hundred points reduce it only to about 1.020 units because the shared calibration remains.
The living notebook
Explore the model
Interactive lab · function
Compare local likelihood curvature
Treat y as an illustrative quadratic negative log likelihood. Reset, set Coefficient a = 0.5 and Position x = 1, and predict y = 0.5. For a fresh comparison Reset, set a = 1 and x = 1, and predict y = 1 and twice the tangent slope.
- y at chosen x
- 0.608
- Tangent slope · 2ax
- 1.35
- Signed area · ax³/3
- 0.182
This lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forOne parabola illustrates local curvature, not a multidimensional likelihood, nuisance marginalization, a calibrated confidence region, or estimated covariance uncertainty.
Pause & reason
Check your understanding
Your turn
Try it yourself
For two synthetic residuals use covariance C = [[2, 1], [1, 2]] in square units. Compute the residual quadratic for r = (1, −1) and for r = (1, 1). Explain why equal Euclidean lengths need not give equal likelihood penalties.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
The inverse covariance is one third times [[2, −1], [−1, 2]]. Contrast and common-mode directions have different variances.
Compare with the solution
For the contrast vector, , giving quadratic 2. For the common vector, , giving quadratic 2/3. Both have ordinary squared length two, but the positively correlated covariance allows larger common displacements than differences. With the same fixed C, determinant terms are identical and do not alter this comparison.
Keep the idea
Take it with you
- A likelihood predicts selected measured data and their joint distribution.
- Shared calibration creates a floor and must not be counted twice.
- Priors, degeneracies, and covariance-estimation uncertainty affect the meaning of a parameter constraint.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.