Likelihood-ratio asymptotics and boundaries
Check the null geometry before assigning chi-square degrees of freedom.
On this page
The question for today
What you’ll understand
- State regular interior conditions behind Wilks-type chi-square limits.
- Derive a boundary likelihood-ratio mixture in a normal model.
- Calculate a one-sided critical value and handle the atom at zero.
A likelihood-ratio statistic compares the best fit under a null model with the best fit in a larger model. Its familiar chi-square approximation relies on local geometric and probabilistic assumptions, not simply a count of free parameters. At a boundary, the likelihood cannot move in every direction, so the limiting optimization changes. A constrained normal mean gives an exact example: the statistic has a point mass at zero and a chi-square component. Deriving that mixture clarifies both critical values and the p-value convention at the atom.
The regular interior theorem has a geometric hypothesis
Consider a correctly specified, fixed-dimensional, dominated model at an identifiable interior point with nonsingular Fisher information. Assume the smoothness, local uniform quadratic likelihood expansion, and consistent full and restricted maximizers needed for regular likelihood asymptotics. If the null is locally a smooth embedded submanifold of codimension , the twice-log-likelihood difference converges to chi-square with degrees of freedom. These hypotheses exclude a boundary point, unidentified nuisance parameters, singular information, and parameter dimensions growing with sample size.
In information-normalized coordinates, the quadratic likelihood is optimized over a linear tangent space for the null and the full Euclidean space for the alternative. Their difference is a squared Gaussian projection onto the orthogonal complement of the null tangent space. This gives the chi-square law and explains why codimension is the relevant count. The geometry must actually be linear at the point; writing down a nominal number of restrictions does not establish the projection argument.
A one-sided cone changes the distribution
For a normal mean constrained to be nonnegative, the maximum-likelihood estimator is the positive part of the sample mean. At a null mean of zero, a negative unconstrained estimate cannot improve the fit over the null. The likelihood-ratio statistic is then zero. A positive unconstrained estimate contributes its usual standardized square. Since a centered normal has equal mass on either side of zero, the resulting distribution mixes a point mass and a one-degree chi-square law with equal weights.
Other boundary problems can have different mixture weights, several chi-square components, or entirely different limits. The answer depends on the parameter constraints, information metric, and whether nuisance parameters remain identified. The half-and-half mixture is a result for the specific one-sided scalar geometry here. In a general cone problem, one derives the limiting optimization or invokes a theorem whose assumptions fit that cone; the presence of any boundary does not by itself identify this distribution.
Tail probabilities must respect the atom
For a positive observed statistic, the upper-tail probability is one half of the corresponding one-degree chi-square tail, equivalently the upper standard-normal tail at its square root. At an observed value of zero, the conventional nonrandomized upper-tail p-value using a greater-than-or-equal event is one: the statistic is always nonnegative. Extending the positive-value formula to zero would ignore the atom and report one half instead. Different randomized conventions must be stated explicitly rather than silently substituted.
For a five-percent test, the correct positive critical value is the square of the ninety-fifth standard-normal percentile. Using the usual ninety-fifth percentile of a one-degree chi-square distribution instead gives a conservative two-and-a-half-percent test in this example. More elaborate boundary models often require specialized asymptotic theory or a carefully validated parametric simulation. A bootstrap is not automatically valid just because the ordinary chi-square rule fails; resampling must reproduce the boundary experiment and its nuisance behavior.
Work it through
A nonnegative mean with known variance
Observe independent variables with . Test . If the sample mean is , calculate the likelihood-ratio statistic and its boundary p-value, then compare the ordinary chi-square tail.
The constrained estimator is . The standard deviation is , so .
The twice-log-likelihood improvement is . Under the null, negative standardized means instead produce .
For this positive statistic, the mixture upper tail is . The ordinary one-degree chi-square upper tail is twice as large, approximately .
The boundary calculation yields a one-sided p-value. If the observed mean had been negative, the statistic would be zero and the conventional nonrandomized p-value would be one.
The living notebook
Explore the model
Interactive lab · function
Squaring alone does not implement a constraint
Pause/Reset and set BOTH controls to , : predict value and slope . For a fresh comparison Pause/Reset and set BOTH to , : value remains and slope is . Manually apply the positive-part rule to these positions: boundary statistics would be and . Changes retain the paused clock.
- y at chosen x
- 0.608
- Tangent slope · 2ax
- 1.35
- Signed area · ax³/3
- 0.182
This lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe instrument plots an ordinary quadratic. The manual clipping calculation reveals the boundary step that an unconstrained square would miss.
Pause & reason
Check your understanding
Your turn
Try it yourself
Find the five-percent critical value for the nonnegative-normal-mean likelihood-ratio test. What is the actual null rejection probability if one instead uses the usual one-degree chi-square five-percent critical value?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
For a positive threshold , the boundary tail is .
Compare with the solution
Solve , giving . The usual one-degree chi-square threshold is . Under the boundary mixture, its upper tail is . Thus that familiar threshold halves the intended size in this specific boundary model.
Keep the idea
Take it with you
- Wilks-type limits require smooth interior null geometry and regular likelihood behavior.
- A scalar one-sided normal boundary produces a specific atom-plus-chi-square mixture.
- Tail calculations at zero must include the atom and state their convention.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.