Von Neumann’s minimax theorem
through Fourier-Motzkin elimination
Abstract
Fourier-Motzkin elimination, a standard method for solving systems of linear inequalities, leads to an elementary, short, and self-contained proof of von Neumann’s minimax theorem.
1 Introduction
Fourier-Motzkin elimination (FME) is a standard method for solving systems of linear inequalities. It was described by Fourier (1826) for a specific problem and rediscovered by Motzkin (1936) in his PhD dissertation; Khachiyan (2009) gives an overview. Analogous to its better-known sibling Gaussian elimination for systems of linear equations, an elimination step involves generating new inequalities, implied by the original ones, from which an unknown “disappears” because it gets a coefficient equal to zero.
FME has been used as a stepping stone to establish intermediate results — like variants of Farkas’ Lemma or the duality theorem in linear programming — which in their turn can be used to prove the minimax theorem of von Neumann (1928). A recent paper that details this convex analysis methodology and gives a great historical overview is von Stengel (2024). But such intermediate steps are unnecessary: FME alone easily establishes the minimax theorem. Section 2 summarizes FME, Section 3 uses it to prove the minimax theorem.
notation: and denote positive integers and . Vectors and have all components equal to zero and one, respectively; is the standard basis vector with -th component equal to one and all others equal to zero. The identity matrix is . Their dimension depends on the context. Unless explicitly written otherwise, vectors are column vectors. The transpose (row vector) of a vector is denoted by . For vectors of equal dimension, means that for all components .
2 A review of Fourier-Motzkin elimination
Given matrix and vector , consider the system of linear inequalities in unknowns :
Divide the inequalities into three types, depending on whether the unknown has a coefficient (G)reater than, (E)qual to, or (L)ess than zero:
Inequalities give upper bounds on . Multiply both sides by and rewrite:
(1) |
Inequalities give lower bounds on . Multiply both sides by and rewrite:
(2) |
Inequalities don’t involve and impose no restrictions on it:
(3) |
So we have a solution to the linear inequalities if and only if , the vector of unknowns from which was eliminated, satisfies the linear inequalities in (3) and those that say that each upper bound it imposes on in (1) is indeed greater than or equal to each lower bound in (2), leaving room to squeeze the remaining unknown in between: for all and all ,
or, equivalently, after rearranging and noticing that the -terms cancel out,
(4) |
These inequalities are nonnegative combinations of those in the original system , i.e., of the form for some nonnegative vector : for inequality in (3), ; and for inequality (4) arising from and , .
Repeating this process to eliminate more unknowns and using that nonnegative combinations of nonnegative combinations of some linear inequalities are themselves such nonnegative combinations yields a crucial insight: after eliminating unknowns, the set
is again the set of solutions to a system of linear inequalities, each of which is a nonnegative combination of those in , i.e., of the form for some nonnegative vector .
3 Von Neumann’s minimax theorem
Fix a matrix where entry is the payoff to player 1 from player 2 if the former chooses row and the latter column . If player 1 assigns probabilities to the rows ( and ) and player 2 assigns probabilities to the columns ( and ), player 1’s expected payoff is . Given , the expected payoff is a convex combination of those in row vector : player 1 is sure that this expected payoff is at least for any number with . Through a clever choice of , the highest expected payoff this player can assure therefore solves
(5) | ||||
Similarly, player 2, who wants to pay as little as possible, can make sure that player 1’s expected payoff is not more than the solution to | ||||
(6) |
Von Neumann’s minimax theorem says that (5) and (6) have the same optimal value. For a proof, it suffices to find such that is feasible in (5) and is feasible in (6). Then solves (5) since each other feasible has
Likewise, solves (6) and both problems have optimal value . Finding such feasible points is easy with FME. To facilitate comparison with Section 2, write all constraints in (6) as linear inequalities , , , and . In matrix form:
(7) |
Proof.
Eliminate by FME from (7) to find, say, linear inequalities , …, in the unknown only, whose solutions are
(8) |
System (7) is feasible and bounds from below by, for instance, the lowest payoff in . Hence, so do the inequalities for : for some . The smallest element of (8) is the greatest lower bound . We may assume that . By FME, inequality or, after rescaling by ,
is a nonnegative combination of those in (7): and for a nonnegative vector . That is,
Consequently, , , and , making feasible in (5). And lies in (8), so is feasible in (6) for some . ∎
This proof requires no topological arguments, like compactness of strategy spaces or continuity of payoffs. It applies equally well if payoffs and probabilities lie in other ordered fields than the reals, like the set of rational numbers. The duality theorem of linear programming can be proved in essentially the same way (Martin, 1999, Thm. 2.29).
References
- Fourier (1826) J. Fourier. Solution d’une question particulière du calcul des inégalités. Nouveau Bulletin des Sciences par la Société philomatique de Paris, pages 99–100, 1826.
- Khachiyan (2009) L. Khachiyan. Fourier-Motzkin elimination method. In C. A. Floudas and P. M. Pardalos, editors, Encyclopedia of Optimization, pages 1074–1077. Springer, 2nd edition, 2009.
- Martin (1999) R. K. Martin. Large scale linear and integer optimization: a unified approach. Springer, 1999.
- Motzkin (1936) T. S. Motzkin. Beiträge zur Theorie der linearen Ungleichungen. Ph.D. thesis, University of Basel, 1936.
- von Neumann (1928) J. von Neumann. Zur Theorie der Gesellschaftsspiele. Mathematische Annalen, 100:295–320, 1928.
- von Stengel (2024) B. von Stengel. Zero-sum games and linear programming duality. Mathematics of Operations Research, 49:1091–1108, 2024.