Interior-point methods and the central path
Derive barrier optimality conditions and use primal-dual complementarity to measure distance from an LP optimum.
On this page
The question for today
What you’ll understand
- Derive perturbed complementarity for a logarithmic barrier LP.
- Compute the central-path duality gap under its feasibility assumptions.
- Distinguish Newton iteration costs from polynomial and strongly polynomial claims.
Simplex works with bases on the boundary of a feasible region. Interior-point methods instead exploit smooth equations inside a strictly feasible domain and approach the boundary through controlled complementarity. The key object is a path of barrier minimizers, not a line segment aimed directly at the optimal vertex. Understanding its equations explains why positive variables, Newton systems, and a small duality gap appear together in solver diagnostics.
Replace the boundary by a barrier
Use the minimization form subject to and . For a parameter , replace nonnegativity by the logarithmic barrier objective , defined only for . The logarithm diverges near a zero coordinate, so a finite barrier minimizer remains inside that domain. Existence is not automatic: the equality set must admit positive points, and the barrier problem must actually attain a minimum. A convenient sufficient setting is strict primal and dual feasibility with full row rank of ; the following derivation assumes a barrier minimizer exists.
A dual vector for the equality constraints is unrestricted, and the minimization dual has slack . Stationarity of the barrier problem gives . Thus the selected primal and dual points are feasible and strictly positive in their inequality coordinates, with for every variable. This is perturbed complementary slackness. As the parameter shrinks, positive primal activity can coexist with a positive dual slack only through an increasingly small product. It is the product, rather than either coordinate alone, that is controlled.
A gap and a Newton system
For a feasible primal-dual pair in this minimization form, the gap is . At an exact central point with nonnegative variables, it equals . Therefore the primal objective lies at most above the optimal value whenever an optimum exists. This is an objective certificate, not a bound on Euclidean distance to a particular optimizer. If the optimal face contains many points, a small objective gap need not select one of them. Approximate centrality and residual errors require corresponding approximate rather than exact statements.
To move toward a smaller target parameter, linearize the primal equations, dual equations, and products simultaneously. The complementarity block is , where is diagonal in the current dual slacks. Solve the resulting coupled linear system for a Newton direction and choose a step that preserves positivity. A full Newton step is not automatically safe. Practical predictor-corrector methods estimate and correct the effects of nonlinearity, while sparse factorization and careful scaling determine much of the computational cost. The smooth path does not eliminate the need for numerical linear algebra.
Assumptions and complexity
A short-step path-following analysis for an appropriate self-concordant barrier can bound Newton iterations by a quantity of order for target objective gap , under the algorithm's initialization and neighborhood assumptions. This is an iteration bound for a specified method, not a claim that each iteration costs constant time. Rational-input bit complexity additionally accounts for arithmetic precision, initialization, and data encoding. Polynomial-time LP algorithms are known, but a general strongly polynomial LP algorithm is still not known. One should not infer it from the attractive iteration count alone.
Lack of strict feasibility needs its own treatment, such as a suitable homogeneous embedding, a Phase I procedure, or reduction to a smaller face. It must not be handled by taking logarithms of forced zero coordinates. Infeasible-start primal-dual methods allow residuals during the search, but then the displayed gap alone does not certify a feasible answer. After convergence, check primal residuals, dual residuals, complementarity, and positivity tolerances together. A crossover procedure may produce a basis after an interior solution when a sparse vertex representation or basis sensitivity report is desired.
Work it through
An exact central point
Minimize subject to and . Verify a central point with .
Choose , satisfying the equality and strict positivity. Complementarity requires , giving .
With and , set . Then , so the proposed dual point is feasible and both slacks are positive.
The primal objective is , and the dual objective is . Their difference is , matching .
The original optimum is one at . The barrier point's actual suboptimality is only , which is at most the certified gap . A duality-gap certificate can be conservative at a nonoptimal dual point.
The exact central point (3/4,1/4), dual multiplier 1/2, and slacks (1/2,3/2) satisfy all central equations and give gap 3/4.
The living notebook
Explore the model
Interactive lab · root-finding
Certify a scalar barrier stationary point
Pause and Reset; set target c to 1 and upper bound U to 2. The separate barrier example has stationary point on positive z. Predict one, then Step. Reset and set c to 4 and U to 3; predict two and inspect the shrinking bracket.
- Midpoint after 0 refinements
- 1.5
- Bracket error bound
- 1.5
- Computed residual · x² − c
- 0.25
Bisection of x² − c on [0,U], capped at 50 iterations for floating-point resolution. The error bound is the maximum distance from the displayed midpoint to either bracket endpoint (half the width in exact arithmetic). Compensated square evaluation preserves the bracket when ordinary multiplication rounds a residual to zero. A truly exact endpoint or midpoint collapses the bracket. This is one monotone quadratic, not a general root solver. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forBisection certifies this one-dimensional stationary root. This quadratic-plus-log example illustrates barrier balance; the instrument does not trace the LP central path or solve its coupled Newton equations.
Pause & reason
Check your understanding
Your turn
Try it yourself
For subject to , find the barrier minimizer of , its dual slack, and its gap for .
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Differentiate on the positive domain, then check the original optimum at the boundary.
Compare with the solution
Stationarity gives , hence . The second derivative is positive, and the objective diverges at both domain ends, proving the unique barrier minimum. With no equalities the dual slack is , so the gap is . The original LP optimum is zero at ; the barrier point is strictly feasible but not exactly optimal.
Keep the idea
Take it with you
- Centrality combines primal feasibility, dual feasibility, positivity, and perturbed complementarity.
- The exact central gap is nμ; it is an objective bound rather than a distance bound.
- Initialization, linear-system costs, and bit precision qualify iteration and complexity claims.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.