Simplex pivots and degeneracy
Derive reduced costs and the ratio test, then distinguish geometric progress from a change of basis.
On this page
The question for today
What you’ll understand
- Compute a reduced cost and a primal feasible pivot step.
- Recognize an improving ray when the ratio test has no bound.
- Explain zero-length pivots, cycling, and qualified complexity claims.
Simplex searches through bases while maintaining primal feasibility. At each iteration, a nonbasic variable offers a direction, a reduced cost measures its objective effect, and the ratio test decides how far the direction can travel before a basic variable reaches zero. These are separate questions: an attractive objective slope does not license an infeasible step. Degeneracy makes the distinction especially important because a legitimate basis exchange can leave both the solution and objective unchanged.
Eliminate the basic coordinates
For minimization in equality standard form, partition the matrix into basic columns and remaining columns . Solving the equalities gives . Substituting into the objective leaves a constant plus the reduced costs times nonbasic coordinates. The reduced cost of column is . It accounts for both the entering variable's direct cost and the cost changes required in the old basic variables. Looking only at the original cost coefficient can therefore select the wrong direction.
If every reduced cost is nonnegative at a primal feasible basis, every feasible nonbasic vector has objective at least the current constant. This is a global optimality proof, not merely a local observation about neighboring vertices. A negative reduced cost permits improvement if a positive feasible step exists. Choose that column to enter, define , and increase its coordinate by . The old basic coordinates become . This formula determines feasibility and handles positive, zero, and negative components of the direction without geometric guessing.
The ratio test and its alternatives
Only components with restrict an increase in the entering coordinate, because they decrease an existing basic coordinate. The largest feasible step is the minimum of over those components. A minimizing coordinate leaves the basis. Components with cannot be used in this minimum: dividing by them either has no meaning or reverses the relevant inequality. If there are no positive components and the reduced cost is negative, arbitrary positive steps stay feasible, providing an explicit improving ray and proving the minimization problem unbounded below.
When the minimum ratio is positive, a negative reduced cost yields strict objective improvement. If it is zero, the exchange is degenerate: the basis changes at the same feasible vector. A tie between positive ratios creates a newly degenerate basis because several coordinates hit zero together. Pivoting still preserves the equations and nonnegativity, but strict descent can no longer prove termination by counting bases. A sequence of zero-length pivots can return to a previous basis under an unfortunate pivot rule. This is cycling, rather than numerical oscillation between approximately equal vectors.
Termination and practical implementation
Bland's rule chooses the eligible entering variable with smallest index and resolves leaving ties by the smallest indexed basic variable. In exact arithmetic this prevents cycling and gives finite termination when a feasible starting basis is available; it does not prove a polynomial pivot bound. Classical simplex pivot strategies can require exponentially many pivots on carefully constructed families. Polynomial-time algorithms for rational linear programming are known through other approaches, while a general strongly polynomial algorithm remains an open question. Practical effectiveness and a worst-case complexity guarantee answer different questions.
Revised simplex implementations solve systems with the basis and update sparse factorizations instead of rebuilding a dense tableau at every iteration. They also monitor primal residuals, dual residuals, scaling, and numerical stability. An apparently negative reduced cost smaller than floating-point uncertainty should not be treated as an exact theorem. Conversely, a rounded zero basic variable may conceal infeasibility. The mathematical pivot derivation supplies invariants that software can test, but robust implementation requires tolerance policies and refactorization safeguards beyond the exact arithmetic lesson.
Work it through
A complete entering step
Minimize with , , and nonnegative variables. Start with the slack basis and let enter.
At the slack basis, and . Basic costs are zero, so the reduced cost of is . Its direction in slack coordinates is .
The positive ratios are and . Thus and leaves. Taking a step of four would violate the second resource restriction.
The new point is . Its objective is , matching the predicted change . This verifies one pivot, without claiming the new basis is already optimal.
The feasible pivot improves the objective by 7.5 and exchanges x for the second slack.
The living notebook
Explore the model
Interactive lab · optimization
Why descent is not a simplex pivot
Pause and Reset; set step size to 0.5 and initial position to 2. Predict the first quadratic gradient step gives one, then Step. Reset, set step size to 1 and initial position to 2, and Step again: the quadratic reaches zero. Compare this unconstrained step rule with the ratio-limited pivot derived above.
- Position x0
- 2
- Objective x²/2
- 2
- Iteration behavior
- Stable step
Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThis instrument performs gradient descent on x²/2. It exposes the role of a step rule, but contains no LP constraints, bases, degeneracy, or simplex ratio test.
Pause & reason
Check your understanding
Your turn
Try it yourself
At a feasible basis, an entering column has , , and . Determine whether the minimization objective is bounded along that direction.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Write the basic coordinates after a general nonnegative step instead of dividing by every component.
Compare with the solution
The basic vector becomes for every , so no basic nonnegativity bound limits the entering variable. The objective changes by and tends to minus infinity. Together with the feasible starting point, this direction certifies unboundedness below.
Keep the idea
Take it with you
- Reduced costs measure objective change after basic variables adjust.
- The minimum positive-direction ratio preserves primal feasibility.
- Anti-cycling ensures finite exact-arithmetic termination, not polynomial worst-case complexity.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.