Standard forms and basic feasible solutions
Translate constraints without changing the optimization problem and connect algebraic bases to vertices.
On this page
The question for today
What you’ll understand
- Translate inequalities and unrestricted variables into equality standard form.
- Compute a basic solution and test its feasibility.
- Explain why a degenerate vertex can have several bases.
A solver needs a precise representation, not just a sketch of a feasible region. Equality standard form packages linear constraints into a matrix equation and nonnegative variables, making rank and linear-system tools available. The translation must preserve feasible choices and objective values even if it adds coordinates. Once that bookkeeping is secure, a basis selects a small invertible subsystem whose solution produces a candidate vertex. Feasibility remains a separate test: solving equations correctly does not guarantee nonnegative coordinates.
Translate with explicit reconstruction
Our equality standard form minimizes subject to and . A constraint becomes with slack ; a greater-than inequality uses a nonnegative surplus subtracted instead. An unrestricted coordinate becomes with , and a lower bound can be removed by a shift. A maximization objective can be negated. Keep an explicit reconstruction map back to original variables and retain any constant introduced into the objective by shifts.
Splitting a free variable is not a one-to-one correspondence: adding the same positive number to both parts leaves the original coordinate unchanged. Nevertheless every original feasible point has an extended feasible representative, and every extended feasible point reconstructs a valid original point with the same objective. This is the right equivalence for optimization. Added redundancy can affect rank and algorithm behavior, so a translation should be economical. Equalities that contradict one another must be detected rather than silently deleted when preparing a full-row-rank system.
Choose independent columns
Assume has independent rows and columns. A basis is a set of column indices whose square submatrix is invertible. Set every nonbasic coordinate to zero and solve . This is a basic solution. It is a basic feasible solution only if every basic coordinate is nonnegative. No sign condition on alone is required: the sign of the particular product with is what matters. Factorizations normally solve this system without explicitly storing an inverse.
For equality standard form with full row rank, the basic feasible solutions are exactly the extreme points. One direction follows because a feasible perturbation supported only on independent basic columns must vanish. For the other direction, the positive-coordinate columns of an extreme point must be independent; a dependence would permit small positive and negative perturbations while keeping nonnegativity. Extend those columns to a basis using full row rank. This argument also explains why a vertex has at most positive coordinates, even when many variables are available.
Zero basic variables and initialization
A basic feasible solution is degenerate when at least one basic coordinate equals zero. Several different bases may then describe the same vector, because a zero coordinate can exchange its role with another zero coordinate without moving the point. Do not identify the number of bases with the number of vertices. In a nondegenerate basic feasible solution all basic coordinates are positive, making its positive support determine the basis uniquely. Degeneracy is common when a model contains redundant-looking active restrictions or balances that force zero activity.
A feasible starting basis is not always visible. Phase I introduces artificial variables and minimizes their sum after arranging a convenient nonnegative right-hand side. A zero Phase I optimum establishes feasibility of the original equalities with nonnegative variables; a positive optimum certifies infeasibility, provided the auxiliary optimization was itself solved correctly. Artificial variables must then be removed or handled through redundant-row cleanup before optimizing the original objective. Numerical tolerances complicate the distinction between zero and a small positive residual, so report residuals and scaling rather than asserting exact feasibility from a rounded display.
Work it through
Two bases, one vertex
For and with all four variables nonnegative, compare the bases and .
For basis , set . The second equation forces , and the first then gives . The basis columns are independent.
For basis , set . The first equation gives , and the second gives . These basis columns are also independent.
Both basic solutions equal . Each basis contains one zero basic coordinate, so both are degenerate representations of the same feasible vertex.
Distinct invertible bases need not produce distinct basic feasible vectors. Both computed bases are feasible and degenerate.
The living notebook
Explore the model
Interactive lab · matrix
Basis invertibility versus conditioning
Pause and Reset; set scale to 1 and shear to 0. Predict determinant one. For a fresh comparison Reset and set scale to 0.25 and shear to 2, then Play. The determinant stays positive, but the singular-value ratio grows: solving in a nearly aligned basis can amplify perturbations.
- Area scale · det A
- 1.4
- Singular values · σmax, σmin
- 1.597, 0.876
- Condition number · κ₂(A)
- 1.823
The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forAn invertible basis permits a unique algebraic solve; good conditioning is an additional numerical question. This triangular two-dimensional family does not choose LP bases or test right-hand-side feasibility.
Pause & reason
Check your understanding
Your turn
Try it yourself
Write subject to with unrestricted in equality minimization standard form, and recover an optimal original solution.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Split the free variable into two nonnegative parts and introduce one slack; negate the objective.
Compare with the solution
Use , , and , . Minimize . The basis containing alone gives , hence and original objective six. The inequality bounds that objective above by six, proving optimality despite the nonunique split representation.
Keep the idea
Take it with you
- Standard-form equivalence needs a reconstruction map and objective bookkeeping.
- A basis solve becomes feasible only after nonnegativity is checked.
- Degenerate vertices can have multiple bases because some basic variables are zero.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.