advanced23 min studyLesson 286 in Mathematics

Interior-point methods and the central path

Derive barrier optimality conditions and use primal-dual complementarity to measure distance from an LP optimum.

On this page

What you’ll understand

  • Derive perturbed complementarity for a logarithmic barrier LP.
  • Compute the central-path duality gap under its feasibility assumptions.
  • Distinguish Newton iteration costs from polynomial and strongly polynomial claims.

Simplex works with bases on the boundary of a feasible region. Interior-point methods instead exploit smooth equations inside a strictly feasible domain and approach the boundary through controlled complementarity. The key object is a path of barrier minimizers, not a line segment aimed directly at the optimal vertex. Understanding its equations explains why positive variables, Newton systems, and a small duality gap appear together in solver diagnostics.

Replace the boundary by a barrier

Use the minimization form min⁡cTx\min c^Tx subject to Ax=bAx=b and x≥0x\ge0. For a parameter μ>0\mu>0, replace nonnegativity by the logarithmic barrier objective cTx−μ∑ilog⁡xic^Tx-\mu\sum_i\log x_i, defined only for xi>0x_i>0. The logarithm diverges near a zero coordinate, so a finite barrier minimizer remains inside that domain. Existence is not automatic: the equality set must admit positive points, and the barrier problem must actually attain a minimum. A convenient sufficient setting is strict primal and dual feasibility with full row rank of AA; the following derivation assumes a barrier minimizer exists.

A dual vector yy for the equality constraints is unrestricted, and the minimization dual has slack s=c−ATy≥0s=c-A^Ty\ge0. Stationarity of the barrier problem gives c−ATy=μX−11c-A^Ty=\mu X^{-1}\mathbf1. Thus the selected primal and dual points are feasible and strictly positive in their inequality coordinates, with xisi=μx_is_i=\mu for every variable. This is perturbed complementary slackness. As the parameter shrinks, positive primal activity can coexist with a positive dual slack only through an increasingly small product. It is the product, rather than either coordinate alone, that is controlled.

Ax=b,ATy+s=c,x>0, s>0,Xs=μ1Ax=b,\quad A^Ty+s=c,\quad x>0,\ s>0,\quad Xs=\mu\mathbf1
These central-path equations assume an attained barrier solution; X is the diagonal matrix with the coordinates of x.↔ Scroll wide equations horizontally.

A gap and a Newton system

For a feasible primal-dual pair in this minimization form, the gap is cTx−bTy=xTsc^Tx-b^Ty=x^Ts. At an exact central point with nn nonnegative variables, it equals nμn\mu. Therefore the primal objective lies at most nμn\mu above the optimal value whenever an optimum exists. This is an objective certificate, not a bound on Euclidean distance to a particular optimizer. If the optimal face contains many points, a small objective gap need not select one of them. Approximate centrality and residual errors require corresponding approximate rather than exact statements.

To move toward a smaller target parameter, linearize the primal equations, dual equations, and products simultaneously. The complementarity block is SΔx+XΔsS\Delta x+X\Delta s, where SS is diagonal in the current dual slacks. Solve the resulting coupled linear system for a Newton direction and choose a step that preserves positivity. A full Newton step is not automatically safe. Practical predictor-corrector methods estimate and correct the effects of nonlinearity, while sparse factorization and careful scaling determine much of the computational cost. The smooth path does not eliminate the need for numerical linear algebra.

cTx−bTy=xTs=nμ,SΔx+XΔs=μtarget1−Xsc^Tx-b^Ty=x^Ts=n\mu,\qquad S\Delta x+X\Delta s=\mu_{\mathrm{target}}\mathbf1-Xs
The first identity gives the exact central gap; the second is the linearized complementarity equation used inside a Newton step.↔ Scroll wide equations horizontally.

Assumptions and complexity

A short-step path-following analysis for an appropriate self-concordant barrier can bound Newton iterations by a quantity of order nlog⁡(initial gap/ε)\sqrt n\log(\text{initial gap}/\varepsilon) for target objective gap ε\varepsilon, under the algorithm's initialization and neighborhood assumptions. This is an iteration bound for a specified method, not a claim that each iteration costs constant time. Rational-input bit complexity additionally accounts for arithmetic precision, initialization, and data encoding. Polynomial-time LP algorithms are known, but a general strongly polynomial LP algorithm is still not known. One should not infer it from the attractive iteration count alone.

Lack of strict feasibility needs its own treatment, such as a suitable homogeneous embedding, a Phase I procedure, or reduction to a smaller face. It must not be handled by taking logarithms of forced zero coordinates. Infeasible-start primal-dual methods allow residuals during the search, but then the displayed gap alone does not certify a feasible answer. After convergence, check primal residuals, dual residuals, complementarity, and positivity tolerances together. A crossover procedure may produce a basis after an interior solution when a sparse vertex representation or basis sensitivity report is desired.

An exact central point

Minimize x1+2x2x_1+2x_2 subject to x1+x2=1x_1+x_2=1 and x≥0x\ge0. Verify a central point with μ=3/8\mu=3/8.

  1. Choose x=(3/4,1/4)x=(3/4,1/4), satisfying the equality and strict positivity. Complementarity requires si=μ/xis_i=\mu/x_i, giving s=(1/2,3/2)s=(1/2,3/2).

  2. With A=(1,1)A=(1,1) and c=(1,2)c=(1,2), set y=1/2y=1/2. Then ATy+s=(1,2)T=cA^Ty+s=(1,2)^T=c, so the proposed dual point is feasible and both slacks are positive.

  3. The primal objective is 3/4+2(1/4)=5/43/4+2(1/4)=5/4, and the dual objective is bTy=1/2b^Ty=1/2. Their difference is 3/43/4, matching x1s1+x2s2=3/8+3/8=2μx_1s_1+x_2s_2=3/8+3/8=2\mu.

  4. The original optimum is one at (1,0)(1,0). The barrier point's actual suboptimality is only 1/41/4, which is at most the certified gap 3/43/4. A duality-gap certificate can be conservative at a nonoptimal dual point.

The result

The exact central point (3/4,1/4), dual multiplier 1/2, and slacks (1/2,3/2) satisfy all central equations and give gap 3/4.

Explore the model

Interactive lab

Interactive lab · root-finding

Certify a scalar barrier stationary point

Pause and Reset; set target c to 1 and upper bound U to 2. The separate barrier example z2/2−clog⁡zz^2/2-c\log z has stationary point z=cz=\sqrt c on positive z. Predict one, then Step. Reset and set c to 4 and U to 3; predict two and inspect the shrinking bracket.

Certify a scalar barrier stationary pointBisection of x² − c on [0,U], capped at 50 iterations for floating-point resolution. The error bound is the maximum distance from the displayed midpoint to either bracket endpoint (half the width in exact arithmetic). Compensated square evaluation preserves the bracket when ordinary multiplication rounds a residual to zero. A truly exact endpoint or midpoint collapses the bracket. This is one monotone quadratic, not a general root solver. Current readings: Midpoint after 0 refinements: 1.5; Bracket error bound: 1.5; Computed residual · x² − c: 0.25. All parameters are adjustable with the labeled controls below.Bisection on x squared minus 2: bracket from 0 to 3 after 0 refinements.00.751.52.253−2.360.192.745.297.84x · bracket stays nonnegativef(x) = x² − cn = 0 · [ 0, 3 ]
Quadratic / midpointCurrent bracketPositive root
Midpoint after 0 refinements
1.5
Bracket error bound
1.5
Computed residual · x² − c
0.25
t = 0 s

Bisection of x² − c on [0,U], capped at 50 iterations for floating-point resolution. The error bound is the maximum distance from the displayed midpoint to either bracket endpoint (half the width in exact arithmetic). Compensated square evaluation preserves the bracket when ordinary multiplication rounds a residual to zero. A truly exact endpoint or midpoint collapses the bracket. This is one monotone quadratic, not a general root solver. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forBisection certifies this one-dimensional stationary root. This quadratic-plus-log example illustrates barrier balance; the instrument does not trace the LP central path or solve its coupled Newton equations.

Check your understanding

An exact primal-dual central point has five nonnegative primal variables and parameter μ = 0.02. What is its objective gap?

Try it yourself

For min⁡x\min x subject to x≥0x\ge0, find the barrier minimizer of x−μlog⁡xx-\mu\log x, its dual slack, and its gap for μ=1/4\mu=1/4.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Differentiate on the positive domain, then check the original optimum at the boundary.

Compare with the solution

Stationarity gives 1−μ/x=01-\mu/x=0, hence x=μ=1/4x=\mu=1/4. The second derivative μ/x2\mu/x^2 is positive, and the objective diverges at both domain ends, proving the unique barrier minimum. With no equalities the dual slack is s=1s=1, so the gap is xs=1/4xs=1/4. The original LP optimum is zero at x=0x=0; the barrier point is strictly feasible but not exactly optimal.

Take it with you

  • Centrality combines primal feasibility, dual feasibility, positivity, and perturbed complementarity.
  • The exact central gap is nμ; it is an objective bound rather than a distance bound.
  • Initialization, linear-system costs, and bit precision qualify iteration and complexity claims.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.