advanced21 min studyLesson 283 in Mathematics

Simplex pivots and degeneracy

Derive reduced costs and the ratio test, then distinguish geometric progress from a change of basis.

On this page

What you’ll understand

  • Compute a reduced cost and a primal feasible pivot step.
  • Recognize an improving ray when the ratio test has no bound.
  • Explain zero-length pivots, cycling, and qualified complexity claims.

Simplex searches through bases while maintaining primal feasibility. At each iteration, a nonbasic variable offers a direction, a reduced cost measures its objective effect, and the ratio test decides how far the direction can travel before a basic variable reaches zero. These are separate questions: an attractive objective slope does not license an infeasible step. Degeneracy makes the distinction especially important because a legitimate basis exchange can leave both the solution and objective unchanged.

Eliminate the basic coordinates

For minimization in equality standard form, partition the matrix into basic columns BB and remaining columns ANA_N. Solving the equalities gives xB=B−1b−B−1ANxNx_B=B^{-1}b-B^{-1}A_Nx_N. Substituting into the objective leaves a constant plus the reduced costs times nonbasic coordinates. The reduced cost of column jj is cj−cBTB−1Ajc_j-c_B^TB^{-1}A_j. It accounts for both the entering variable's direct cost and the cost changes required in the old basic variables. Looking only at the original cost coefficient can therefore select the wrong direction.

If every reduced cost is nonnegative at a primal feasible basis, every feasible nonbasic vector has objective at least the current constant. This is a global optimality proof, not merely a local observation about neighboring vertices. A negative reduced cost permits improvement if a positive feasible step exists. Choose that column to enter, define d=B−1Ajd=B^{-1}A_j, and increase its coordinate by θ\theta. The old basic coordinates become xB−θdx_B-\theta d. This formula determines feasibility and handles positive, zero, and negative components of the direction without geometric guessing.

cTx=cBTB−1b+∑j∈Ncˉjxj,cˉj=cj−cBTB−1Ajc^Tx=c_B^TB^{-1}b+\sum_{j\in N}\bar c_jx_j,\qquad \bar c_j=c_j-c_B^TB^{-1}A_j
Nonnegative reduced costs certify a lower bound for every feasible nonnegative nonbasic vector.↔ Scroll wide equations horizontally.

The ratio test and its alternatives

Only components with di>0d_i>0 restrict an increase in the entering coordinate, because they decrease an existing basic coordinate. The largest feasible step is the minimum of xBi/dix_{B_i}/d_i over those components. A minimizing coordinate leaves the basis. Components with di≤0d_i\le0 cannot be used in this minimum: dividing by them either has no meaning or reverses the relevant inequality. If there are no positive components and the reduced cost is negative, arbitrary positive steps stay feasible, providing an explicit improving ray and proving the minimization problem unbounded below.

When the minimum ratio is positive, a negative reduced cost yields strict objective improvement. If it is zero, the exchange is degenerate: the basis changes at the same feasible vector. A tie between positive ratios creates a newly degenerate basis because several coordinates hit zero together. Pivoting still preserves the equations and nonnegativity, but strict descent can no longer prove termination by counting bases. A sequence of zero-length pivots can return to a previous basis under an unfortunate pivot rule. This is cycling, rather than numerical oscillation between approximately equal vectors.

θ∗=min⁡i:di>0xBidi,Δ(cTx)=θ∗cˉj\theta^*=\min_{i:d_i>0}\frac{x_{B_i}}{d_i},\qquad \Delta(c^Tx)=\theta^*\bar c_j
The ratio test limits feasibility; the reduced cost converts the allowed step into objective change.↔ Scroll wide equations horizontally.

Termination and practical implementation

Bland's rule chooses the eligible entering variable with smallest index and resolves leaving ties by the smallest indexed basic variable. In exact arithmetic this prevents cycling and gives finite termination when a feasible starting basis is available; it does not prove a polynomial pivot bound. Classical simplex pivot strategies can require exponentially many pivots on carefully constructed families. Polynomial-time algorithms for rational linear programming are known through other approaches, while a general strongly polynomial algorithm remains an open question. Practical effectiveness and a worst-case complexity guarantee answer different questions.

Revised simplex implementations solve systems with the basis and update sparse factorizations instead of rebuilding a dense tableau at every iteration. They also monitor primal residuals, dual residuals, scaling, and numerical stability. An apparently negative reduced cost smaller than floating-point uncertainty should not be treated as an exact theorem. Conversely, a rounded zero basic variable may conceal infeasibility. The mathematical pivot derivation supplies invariants that software can test, but robust implementation requires tolerance policies and refactorization safeguards beyond the exact arithmetic lesson.

A complete entering step

Minimize −3x−2y-3x-2y with x+y+s1=4x+y+s_1=4, 2x+y+s2=52x+y+s_2=5, and nonnegative variables. Start with the slack basis and let xx enter.

  1. At the slack basis, s1=4,s2=5s_1=4,s_2=5 and x=y=0x=y=0. Basic costs are zero, so the reduced cost of xx is −3-3. Its direction in slack coordinates is d=(1,2)d=(1,2).

  2. The positive ratios are 4/1=44/1=4 and 5/2=2.55/2=2.5. Thus θ∗=2.5\theta^*=2.5 and s2s_2 leaves. Taking a step of four would violate the second resource restriction.

  3. The new point is x=2.5,y=0,s1=1.5,s2=0x=2.5,y=0,s_1=1.5,s_2=0. Its objective is −7.5-7.5, matching the predicted change 2.5(−3)2.5(-3). This verifies one pivot, without claiming the new basis is already optimal.

The result

The feasible pivot improves the objective by 7.5 and exchanges x for the second slack.

Explore the model

Interactive lab

Interactive lab · optimization

Why descent is not a simplex pivot

Pause and Reset; set step size to 0.5 and initial position to 2. Predict the first quadratic gradient step gives one, then Step. Reset, set step size to 1 and initial position to 2, and Step again: the quadratic reaches zero. Compare this unconstrained step rule with the ratio-limited pivot derived above.

Why descent is not a simplex pivotGradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Current readings: Position x0: 2; Objective x²/2: 2; Iteration behavior: Stable step. All parameters are adjustable with the labeled controls below.−4−202402.174.356.528.7Parameter xf(x) = x²/2n = 0
ObjectiveDiscrete iterate
Position x0
2
Objective x²/2
2
Iteration behavior
Stable step
n = 0 · t = 0 s

Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forThis instrument performs gradient descent on x²/2. It exposes the role of a step rule, but contains no LP constraints, bases, degeneracy, or simplex ratio test.

Check your understanding

In a minimization pivot, the reduced cost is −2, xB = (0,3), and d = (1,1). What does the exact ratio test give?

Try it yourself

At a feasible basis, an entering column has cˉj=−1\bar c_j=-1, xB=(2,5)x_B=(2,5), and d=(−1,0)d=(-1,0). Determine whether the minimization objective is bounded along that direction.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Write the basic coordinates after a general nonnegative step instead of dividing by every component.

Compare with the solution

The basic vector becomes (2+θ,5)(2+\theta,5) for every θ≥0\theta\ge0, so no basic nonnegativity bound limits the entering variable. The objective changes by −θ-\theta and tends to minus infinity. Together with the feasible starting point, this direction certifies unboundedness below.

Take it with you

  • Reduced costs measure objective change after basic variables adjust.
  • The minimum positive-direction ratio preserves primal feasibility.
  • Anti-cycling ensures finite exact-arithmetic termination, not polynomial worst-case complexity.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.