Verifying Approximate Equilibrium in Auctions
Abstract
In practice, most auction mechanisms are not strategy-proof, so equilibrium analysis is required to predict bidding behavior. In many auctions, though, an exact equilibrium is not known and one would like to understand whether—manually or computationally generated—bidding strategies constitute an approximate equilibrium. We develop a framework and methods for estimating the distance of a strategy profile from equilibrium, based on samples from the prior and either bidding strategies or sample bids. We estimate an agent’s utility gain from deviating to strategies from a constructed finite subset of the strategy space. We use PAC-learning to give error bounds, both for independent and interdependent prior distributions. The primary challenge is that one may miss large utility gains by considering only a finite subset of the strategy space. Our work differs from prior research in two critical ways. First, we explore the impact of bidding strategies on altering opponents’ perceived prior distributions—instead of assuming the other agents to bid truthfully. Second, we delve into reasoning with interdependent priors, where the type of one agent may imply a distinct distribution for other agents. Our main contribution lies in establishing sufficient conditions for strategy profiles and a closeness criterion for conditional distributions to ensure that utility gains estimated through our finite subset closely approximate the maximum gains. To our knowledge, ours is the first method to verify approximate equilibrium in any auctions beyond single-item ones. Also, ours is the first sample-based method for approximate equilibrium verification.
Keywords equilibrium verification auctions interdependent distributions dispersion
1 Introduction
A central problem in mechanism design is understanding the strategic incentives of participants–in order to design mechanisms that lead to desired outcomes. A Bayesian Nash Equilibrium (BNE) (Harsanyi, 1967) represents a fixed point in strategy space, where no agent has an incentive to deviate. This concept constitutes the central solution concept for games with incomplete information, such as auctions.
Mechanism design devotes significant attention to designing incentive-compatible mechanisms, where truthful bidding constitutes a BNE (Hurwicz, 1972). When bidders are aware that it is in their best interest to report their true valuation for an item, this knowledge leads to several desired effects. For example, one can guarantee efficient outcomes, ensuring that the item is allocated to the bidder who values it the most. Furthermore, it simplifies the strategic decision-making process for the bidders, thereby saving resources.
Nonetheless, practitioners typically employ mechanisms that are not incentive compatible, referred to as manipulable mechanisms. For instance, the first-price mechanism is commonly used in real-world auctions. In the context of multi-unit sales, the U.S. Treasury has utilized discriminatory auctions for selling treasury bills since 1929 (Krishna, 2009). Moreover, combinatorial auctions in practice typically use manipulable mechanisms such as first-price payments for their simplicity and other desirable features, or core-selecting payment rules intended to ensure the winners’ payments are sufficient to maintain envy-freeness (Day and Milgrom, 2008).
Several factors were identified why manipulable mechanisms are prevalent in practice. First, their rules are typically more straightforward to communicate. Second, incentive-compatible mechanisms have the potential to more readily expose the bidders’ confidential private information (Rothkopf et al., 1990). Third, if information acquisition is costly, even incentive-compatible mechanisms have no dominant strategy for making information-gathering or valuation-computation decisions (Sandholm, 2000; Larson and Sandholm, 2001). Additionally, incentive-compatible mechanisms, like the VCG mechanism (Vickrey, 1961; Clarke, 1971; Groves, 1973), exhibit significant drawbacks in combinatorial auction contexts. First, they can result in minimal or even null revenues in spite of intense competition for the items (Conitzer and Sandholm, 2006; Ausubel and Milgrom, 2006). Second, they may encourage collusion (Conitzer and Sandholm, 2006; Day and Milgrom, 2008). Third, they may beget arbitrage opportunities (Gilpin and Sandholm, 2004). Fourth, mechanisms that are incentive compatible in single-shot settings—like the VCG—typically do not remain incentive compatible over time across auctions where complementary or substitutable items are sold (Sandholm, 2000). Fifth, in scenarios such as sourcing, the repeated application of an incentive-compatible mechanism is not incentive compatible as the bid taker uses bids from one auction to modify the parameters (reserve prices or more sophisticated parameters) of future auctions (Sandholm, 2013).
Despite the significant academic work in auction theory, equilibrium strategies for manipulable mechanisms are primarily known only for very restricted, simple market models, such as single-item auctions with independent prior distributions (Krishna, 2009). Even worse, equilibria are not known to exist in general, but only in specific settings (Athey, 2001; Reny, 2020). Fortunately, every strategy profile can be considered a -Bayesian Nash Equilibrium (-BNE) for some approximation factor . Intuitively, measures the potential utility gain an agent could achieve by deviating from its current strategy, assuming the other agents’ strategies remain unchanged.
As a result, recent efforts have concentrated on identifying strategies with an as small as possible. Several computational techniques have demonstrated promise in discovering strong bidding strategies (e.g.,(Bosshard et al., 2020; Bichler et al., 2021, 2023a, 2023b)). Although there is strong empirical evidence suggesting that the approximation factor is small for the computed strategies, their theoretical guarantees are limited in settings where no analytical equilibrium is available. Bichler et al. (2023b) rely on significant assumptions, including complete knowledge of the joint and marginal prior distributions, and their results are restricted to single-item auctions. Bosshard et al. (2020) introduce error bounds based on the precise calculation of metrics that are typically intractable to compute, such as the best-response ex interim utility. Meanwhile, Bichler et al. (2021, 2023a) employ a sampling-based strategy but do not provide error bounds.
1.1 Contributions
We introduce techniques with provable guarantees that identify the smallest approximation factor for a strategy profile. Our methods require only access to samples from the type and bid distribution. The bids can either be observed directly, or, given access to the strategies, one can map the sampled types to their corresponding bids. Our results are applicable to single- and multi-item auctions with independent and interdependent prior distributions.
We analyze both the ex interim and ex ante settings.111We exclude the study of ex post approximate equilibrium from our analysis because these concepts are based on worst-case, distribution-independent notions, rendering it impractical to assess through sampling from agents’ type distributions. In the ex interim case, we bound the amount any agent can improve its utility by deviating from its current strategy, in expectation over the other agents’ types, regardless of its own true type. In the weaker ex ante setting, the expectation also includes the agent’s own true type.
Our estimate is simple. It measures the maximum utility an agent can gain by deviating from its current strategy, averaged over the samples, where the alternative strategies considered are from a finite subset of the strategy space. We present upper bounds in the ex interim case, denoted by , and in the ex ante case, denoted by . Specifically, we offer ex interim guarantees for scenarios with independent prior distributions and ex ante guarantees for interdependent prior distributions.
Prior sampling-based methods operated under the assumption that agents play truthfully and have independent prior distributions, meaning they were only capable of verifying the truthful strategy under independent priors (Balcan et al., 2019a). We expand upon this in two significant ways. First, our results hold for a large class of bidding strategies (as long as bids can neither change too fast nor too slowly as a function of an agent’s type). This class satisfies common assumptions on equilibrium strategies made in auctions, such as monotonicity (Reny, 2011, 2020). Second, we introduce findings for interdependent prior distributions. To achieve this, we consider a partition of an agent’s type space and establish an upper bound on the estimation error that utilizes the maximum total variation distance between the opponents’ conditional distribution within each element . In the arXiv version of their EC-19-Exemplary-AI-Paper-Award-winning extended abstract, Balcan et al. (2019a) also presented—among other results—ex ante guarantees for interdependent prior distributions. However, they retracted that result after we pointed out that it is incorrect (Balcan et al., 2019b). That approach was flawed because it did not consider bidding strategies that can be functions of a bidder’s type.
We apply our estimation technique across several important auction classes. For instance, in the first-price auction, our error bound for a is , where is the number of bidders, is the number of samples within , denotes the range of the prior density, is the maximum Lipschitz constant of an agent’s inverse bidding strategy, and denotes the maximum total variation distance among the conditional prior distributions for types from . It is important to note that does not need to become small for every in order to provide meaningful ex ante guarantees, as the overall bound for the entire partition can still be small in expectation. For the case of independent prior distributions, this bound improves to become an ex interim guarantee with and .
We present similar results for a variety of auction formats, including combinatorial first-price auctions, uniform-price auctions, and discriminatory auctions.
Key challenges To prove our guarantees, we aim to estimate the maximum possible amount an agent can improve its utility by deviating from its current strategy in both the ex interim and ex ante cases, respectively. We determine our error bounds, or , by quantifying the extent to which an agent may improve its utility, averaged over the samples, when considering alternative strategies from a finite set. To achieve this, we encounter two major technical challenges.
The first challenge arises from the limitation of searching over a finite set, potentially causing an agent to miss strategies that could significantly improve its utility. This occurs from auctions often having discontinuities in the utility functions. For instance, in both first- and second-price auctions, a slight increase in an agent’s bid from just below to just above the highest bid of other agents alters the allocation, resulting in a sudden jump in utility. For a given type of an agent, we consider a grid with an edge length over the action space, assuming the action space is for some integer . The critical question then becomes how much potential utility might be missed when searching over this finite grid and the effect of on this potential loss.
To tackle this issue, we utilize the concept of dispersion (Balcan et al., 2018a). In broad terms, a set of piecewise Lipschitz functions is -dispersed if every ball of radius in the domain contains no more than discontinuities of the functions. Given samples from the prior and bidding distributions, we examine the dispersion of a set of ex post utility functions, each defined by a sample and varying over one agent’s bid. We demonstrate that if this set of functions is sufficiently dispersed, it is possible to control the error by searching for a best response over a finite grid with edge length , rather than in the infinite action space. Crucially, we establish sufficient conditions on both the prior distribution and bidding strategies to ensure this approach is viable.
The second major challenge arises under interdependent prior distributions. In such contexts, an agent gains additional information about the opponents’ prior distributions upon learning its type. Given the continuous nature of these distributions, the probability of drawing the identical type more than once is zero, leading to the expectation that one would not collect more than a single sample from the same conditional prior distribution. We tackle this issue by considering a partition of the type space for each agent and grouping samples that fall into the same element . We demonstrate that if the total variation distance for the conditional distributions from types within is sufficiently small, then the aggregated samples can provide valuable insights about the conditional prior distributions for all types from .
Finally, provided that the intrinsic complexities of the agents’ utility functions are manageable (as determined by the learning-theoretic concept of pseudo-dimension (Pollard, 1984)), our empirical estimates and quickly converge to the true approximation factors as the sample size increases.
2 Related research
In this section, we discuss additional related work on equilibrium-verification methods, emphasizing the contributions and limitations of prior efforts.
Estimating approximate incentive compatibility Balcan et al. (2019a) introduce techniques to estimate the proximity of a mechanism to being incentive compatible, specifically addressing the utility loss associated with truthful strategies. By analyzing samples from agents’ type distributions, their method evaluates potential utility gains from misreporting types, leveraging finite subsets of the type space. The work provides PAC-guarantees for the approximation of incentive compatibility, utilizing the pseudo-dimension and dispersion of utility functions, and applies these techniques across a variety of common auction formats. The paper received the Exemplary AI Track Paper award at the ACM Conference on Economics and Computation (EC) in 2019. Building on these results, we derive sampling-based error bounds and extend them in two significant directions: first, by accommodating strategic bidding, thereby determining the utility loss for strategies beyond truthful bidding, and second, by offering guarantees for interdependent prior distributions as well.
Verification via game abstraction Game abstraction is a key technique for solving large imperfect-information games (Shi and Littman, 2000; Billings et al., 2003; Gilpin and Sandholm, 2006), and has led to breakthroughs such as superhuman AIs for two-player limit Texas hold’em Bowling et al. (2015), two-player no-limit Texas hold’em Brown and Sandholm (2018), and multiplayer no-limit Texas hold’em Brown and Sandholm (2019). The basic idea is that the game is automatically abstracted into a smaller game, then the smaller game is solved for (approximate) equilibrium, and then the strategies are mapped back into the original game. However, most game abstraction techniques do not yield guarantees for equilibrium approximation in the original game (Waugh et al., 2009). Gilpin and Sandholm (2007) developed a lossless abstraction technique for games with finite actions and finite states that yields an exact equilibrium in the original game, but the abstracted game to be solved is only about two orders of magnitude smaller than the original game, so that does not scale to very large games. More recently, game abstraction techniques that can abstract more and still yield a provably approximate equilibrium in the original game have been developed (Sandholm and Singh, 2012; Kroer and Sandholm, 2014, 2016, 2018). Some game abstraction work has focused on games with continuous actions (Kroer and Sandholm, 2015). However, these models typically are not rich enough to model a Bayesian game with continuous types and actions, and have not yielded techniques for verifying approximate equilibrium in auctions.
Bichler et al. (2023b) perform an abstraction by discretizing the valuation and bidding spaces to compute and verify equilibrium using distributional strategies, providing theoretical guarantees that the abstraction error can be controlled in the case of single-item auctions. Their verification results assume explicit access to both the joint and marginal prior density functions, allowing for querying at specific points and integrating over cells of their discretization. In contrast, our results only assume access to the prior distribution through sampling. Additionally, our findings are also applicable to multi-unit auctions and combinatorial auctions.
Pieroth et al. (2023) offer a verification method using a limiting argument applicable to sequential games with continuous observation and action spaces. However, their assumption of continuous utility functions means that their results do not directly apply to auctions. Instead, they rely on a game abstraction strategy that involves smoothing the allocation and price functions, drawing from the work of Kohring et al. (2023). They demonstrate that the abstraction error can be controlled for single-unit auctions with independent prior distributions. In contrast to their work, we provide explicit bounds that can be computed for a specific setting and sample size. Additionally, our results apply to multi-unit and combinatorial auctions, and with interdependent priors.
Verification methods in full auction games Timbers et al. (2020) propose a reinforcement learning-based method to estimate a lower bound on the maximum utility loss. While this can provide valuable insight into potential gains from deviation, it does not verify whether the candidate strategy profile is an approximate equilibrium. On the other hand, the work by Bosshard et al. (2020) introduces a verification method for approximate equilibrium strategies in combinatorial auctions with independent prior distributions. Similar to our approach, they approximate the utility loss at a finite number of grid points. They employ a Monte-Carlo sampling method to estimate the expected utility and use a local search algorithm to estimate the best response for each grid point. Additionally, they exploit a convexity property of the best-response ex interim utility to provide an upper bound of the utility loss for all valuations between the grid points. However, their theoretical analysis does not account for the approximation errors introduced by the sampling procedure and the best-response approximation. In contrast, our error bounds encompass all approximations performed. Furthermore, their analysis is restricted to auctions with independent prior distributions.
Ex post incentive-compatible mechanism design via deep learning In recent years, deep learning approaches to design auction mechanisms have received significant attention (Golowich et al., 2018; Feng et al., 2018; Duetting et al., 2019). These efforts aim to design mechanisms that are nearly incentive compatible by incorporating constraints into the deep learning optimization problem. These constraints enforce the mechanism to be ex post incentive compatible over a set of buyer values sampled from the prior distribution. Essentially, they seek to identify a mechanism where a bidder has approximately no incentive to conceal its valuation, regardless of the reported valuations of the opponents—a property that does not hold for most mechanisms used in practice. Duetting et al. (2019) offer a concentration bound to empirically assess the violation of incentive compatibility. However, this bound presumes that the ex post violation can be precisely determined, an assumption not met by their methodology. (Curry et al., 2020) address this issue by linearizing the learned neural network, effectively reducing the problem to an integer program that allows for an accurate estimation of the error. Curry et al. (2023) use deep learning to learn auction mechanisms within randomized affine maximizer auctions, a class within which each mechanism is exactly incentive compatible.
The concept of ex post incentive compatibility is a worst-case, distribution-independent notion focused on the utility gain from truthful bidding. This contrasts with our objectives, as we aim to provide ex interim and ex ante guarantees, where agents have no incentive to deviate from their current strategy—which might not be truthful—averaged over the opponents’ type distribution.
3 Preliminaries
This section introduces the formal model and results from learning theory that are useful for our purposes.
3.1 The model
We model an auction as a Bayesian game . Here denotes the number of agents. denotes an atomless prior distribution over the agents’ observations and valuations , and is assumed to be common knowledge. We denote its marginals by , etc.; its conditionals by , etc. An agent receives its private observation , and chooses an action or bid based on it. The joint bidding space is denoted by . The sets denote an agent’s “true”, but possibly unobserved valuation. This formulation allows to model interdependencies and correlations beyond purely private or common values. The vector describes the individual (ex post) utility functions that map a valuation and bid profile to a game outcome for each agent. The game consists of three distinct stages. During the ex-ante stage, that is, before the game, agents have only knowledge about . In the ex interim stage, each agent observes which provides information about its valuation . After submitting a bid , an agent receives the ex post information about the game outcome . In the ex ante stage, an agent needs to reason about a strategy that maps observations to bids. We denote agent ’s pure strategy space by . The joint strategy space is then denoted by .
In this work, we are particularly concerned with the agents’ bidding distributions. That is, the distribution of bids for an agent , where and . We denote the distribution with mapped bids under strategy profiles by , and , respectively. We define the ex interim utility for agent and observation as
(1) |
and the ex ante utility as
(2) |
We focus on sealed-bid auctions involving distinct items. In combinatorial auctions, this results in a set representing all possible bundles, with valuation and action spaces of size . An auction’s outcome, given a bid profile , is determined by an auction mechanism M that decides on two things: the allocation with , dividing the items among bidders, and the price vector , indicating the cost for each bidder to claim their items. When considering a specific mechanism M, we denote the respective utility function for bidder by . In a typical risk-neutral model, bidders’ utilities are captured by quasilinear payoff functions . Furthermore, we assume222Our error bound increases by a multiplicative factor of if the range of utility functions is instead of . the utility functions map to the bounded interval . We are interested in the game-theoretic solution concept of an approximate Bayesian Nash Equilibrium (BNE) (Harsanyi, 1967).
Definition 3.1 (-Bayesian Nash equilibrium).
Let M be a mechanism and a corresponding Bayesian game. Let , then, a strategy profile is an ex ante -BNE if, for all , . A so-called ex interim -BNE is given if, for all and , .
Clearly, if we have an ex interim -BNE, then this also constitutes an ex ante -BNE. This may not hold the other way around, as it is only guaranteed that the utility gained through deviating to another strategy is bounded by in expectation. For some observations , it may be strictly larger.
The ex ante utility loss is a metric to measure the loss of an agent by playing instead of a best-response to the opponents’ strategies (Srinivasan et al., 2018; Brown et al., 2019). It expresses the distance to an approximate ex ante equilibrium and is defined as . Similarly, the ex interim utility loss measures the loss of agent for observation of playing instead of an ex interim best-response to . It is given by .
We assume access to a dataset of independent samples from the unknown prior distribution in the following form. We sample a dataset , comprising ex interim and ex post data for each agent. consists of tuples of observations and valuations,
Either by accessing the strategy profile or by observing the bids for each data point in , we obtain the full dataset of observations, valuations, and bids. This dataset is denoted by
3.2 Concentration bounds from learning theory
We introduce a distribution-independent concentration bound that allows us to approximate the expected utilities by an empirical mean over . It is grounded in the learning theoretic concept of the pseudo-dimension. This concept captures the inherent complexity of a function class, essentially reflecting how challenging it is to learn. The pseudo-dimension is defined as follows:
Definition 3.2 (Mohri et al. (2012)).
Let be an abstract class of functions. Further, let and be a set of targets. We say that witness the shattering of by if for all subsets , there exists some function such that for all , and for all , . If there exists some vector that witnesses the shattering of by , then we say that is shatterable by . Finally, the pseudo-dimension of , denoted by , is the size of the largest set that is shatterable by .
A standard result for an abstract generalization bound is provided by the next theorem.
Theorem 3.3 (Mohri et al. (2012, Theorem 10.6)).
Let be a distribution over and . Set , then, with probability over a draw , for all , it holds that
4 Challenges for sampling-based equilibrium verification
In this section, we outline our general approach and discuss some of the key challenges that must be overcome to articulate a statement of the following nature: For a strategy profile , with probability over the draw of the dataset , for any agent , one can guarantee, (1) for all observations , or (2) .
We want to give upper bounds or that are as tight as possible to the true values of the utility losses. However, computing the utility losses and is intractable in general. This difficulty arises from two major challenges. First, one cannot evaluate the expected utilities for even a single instance due to the potentially intractable nature of the integrals involved. Second, computing the best-response utilities requires a search over an infinite space.
To overcome these obstacles, our approach is twofold. We approximate the integrals by calculating the empirical mean of the ex post utility over suitable subsets of the dataset . This process is referred to as the simulation step. To address the issue of searching over an infinite space for the best-response utilities, we constrain this search to a finite set, a method we denote as the discretization step. To this end, let . We then consider a so-called -grid . That is, is a finite set such that for every there exists a such that .
We illustrate our approach by detailing the steps involved in estimating agent ’s ex interim utility loss for an observation and strategy profile through an explicit example.
Example 4.1.
Consider a first-price single-item auction with two bidders and independent priors. The two bidders receive their true valuations as observations, that is, . We set . The utility function for agent is then given by . The problem of determining the ex interim utility loss for a valuation for agent is the optimization problem
(3) |
where agent bids according to . Further, consider the dataset of samples of bid queries that can be extracted from . Then, the estimator that searches a best-response over a finite set of the empirical mean as described above is given by
(4) |
The challenge presented in the aforementioned example centers on mitigating the estimation error between Equation 3 and its approximation through Equation 4. To address this, we propose to limit the approximation error associated with employing the empirical mean (simulation step) by applying a classic learning theoretic concentration bounds.
However, controlling the error introduced during the discretization step–namely, restricting the search to a finite set–proves more challenging due to the discontinuous nature of the utility functions. A minor variation in the bid can affect the allocation outcome, thereby causing abrupt shifts in agent ’s utility. This discontinuity poses a particular problem when working with finite precision , as it might prevent agent from achieving substantial improvements in utility due to the granularity of the bid increments. We control this by considering the concept of dispersion.
Definition 4.2 (Balcan et al. (2018a)).
Let be a set of functions where each is piecewise Lipschitz with respect to the -norm over a partition of . We say that splits a set if intersects with at least two sets in . The set of functions is -dispersed if for every point , the ball is split by at most of the partitions
Dispersion quantifies the number of discontinuities present within any given ball of width . The larger the value of and the smaller the value of , the more “dispersed” the discontinuities of the functions are. For a -dispersed set of functions, at most jump discontinuities occur within a ball of radius . Thus, within any ball of radius , at least functions exhibit -Lipschitz continuity, while at most do not.
Considering Example 4.1, assume the functions are -dispersed. Then, for any with , we can bound the difference by
For sufficiently small , the error is small. Therefore, if we can ensure that the discontinuities are sufficiently dispersed with high probability, the error from searching over can be controlled.
The approach we have outlined aligns with the work of Balcan et al. (2019a). However, in our scenario, an agent must reason about the opponents’ bid distribution rather than the prior distribution directly. Next, we discuss the additional considerations necessary for this.
4.1 Sufficient properties for strategies to be verifiable
We address the question of identifying the kinds of bidding strategies that can be effectively verified using the approach outlined above. To achieve meaningful dispersion guarantees, we discuss specific sufficient conditions of regularity for strategies to be verifiable.
We observed that the concept of dispersion hinges on a sufficient spread of discontinuities, implying in our context that the opponents’ bidding distribution should not be too concentrated. Initially, we assume the prior distribution to be -bounded, meaning it possesses a -bounded density function , that is, . However, the bidding distribution may still exhibit concentration even if the prior distributions do not. We demonstrate that a bounded prior distribution remains bounded under a bidding strategy if the bidding strategy is sufficiently smooth and changes with a minimal rate over the received observation. More specifically, we demand the bidding strategies to be bi-Lipschitz continuous.
Definition 4.3 (Bi-Lipschitz function, Verine et al. (2023)).
Let . A bijective function is said to be -bi-Lipschitz if is -Lipschitz and its inverse is -Lipschitz, that is, for all and
The bi-Lipschitz continuity ensures that neither the function nor its inverse can change arbitrarily fast. More precisely, our approximation results in the following sections are valid for the set of bidding strategies for an agent , defined as
For a strategy , we denote the bi-Lipschitz constants by . Further, define . We leverage the properties of bi-Lipschitz functions to bound the density function of the bidding distribution.
Theorem 4.4.
Let for all . Denote with and the density functions for the marginal prior distributions and for any . Further assume that and are -bounded density functions for some . Further, let be a strategy profile of bi-Lipschitz continuous bidding strategies. Then, the probability density functions of the bidding distributions and satisfy
Proof sketch.
By the definition of bi-Lipschitz continuity, the function is invertible for any . We perform a change of variables and get for
where denotes the dimension of . We used a well-known bound on a bi-Lipschitz mapping’s Jacobian determinant in the second step. The case of two agents is similar and additionally leverages a property of the determinant for block matrices. The full proof is in Appendix C. ∎
To illustrate the effect, Figure 1 shows how the density function of a beta-distribution is transformed under different strategies. Linear transformations such as restrict the bidding space to , which compresses the density and leads to a higher maximum value. The mapping leads to an unbounded density, which can occur because its inverse is not Lipschitz continuous. However, the bidding strategy under the mapping remains bounded, even though the mapping itself is not bi-Lipschitz continuous. The prior density assigns a high mass to valuations close to zero, but the strategy increases rapidly enough to redistribute a significant amount of mass away from zero. These examples underscore that while our assumptions provide a sufficient condition for the verification of bidding strategies, our findings may extend to a broader class of bidding strategies and prior distributions.
![Refer to caption](extracted/5804556/figs/transformation_beta_density_function.png)
This raises the question of how restrictive it is to consider only strategies from for verification. Continuously differentiable is a common assumption met by most function approximation techniques, such as neural networks, making this restriction relatively mild. The restriction to bi-Lipschitz continuous strategies is more stringent. In the one-dimensional case, this translates to the bid strategy being strictly monotonic. Monotonicity is a very common assumption for strategies in auctions, where bids are assumed not to decrease with a rising valuation (Reny, 2020). In the standard model that we consider here, strict monotonicity remains a reasonable assumption. Furthermore, known equilibrium strategy profiles commonly fall within this set (Krishna, 2009). Nevertheless, under model assumptions such as reserve prices or budget constraints, bidders may resort to constant bidding for a range of observations, so that their strategies do not lie within .
5 Verifying approximate equilibrium under independent priors
In this section, we give guarantees for the maximum ex interim utility loss for a given strategy profile under the common assumption of independent prior valuations (Lubin and Parkes, 2012; Azevedo and Budish, 2019; Hart and Nisan, 2012; Chawla and Hartline, 2013). Specifically, we consider an auction , simplifying several aspects. For all agents , we assume , and a drawn observation equals the true valuation , allowing us to omit the observation space entirely. Furthermore, the prior distribution simplifies to a product distribution over the valuation spaces, that means, . A bidding strategy is then a mapping from agent ’s valuation space onto itself, .
In the ex interim stage, agent must reason about the opponents’ bid distribution given its valuation . We organize the dataset as follows: denote with the dataset of agent ’s opponents’ bids. Then consists of i.i.d. samples from .
5.1 A sampling-based bound on the ex interim utility loss via grid search
We start with the sampling step of our approach, presenting a result to estimate the ex interim utility loss by considering the empirical mean instead of the expectation. We use a classical PAC-learning result (Theorem 3.3) to bound the error incurred by taking the empirical mean compared to evaluating the integral, demonstrating that this error converges towards zero as the number of samples increases. For mechanism M and agent , define the class of functions that map opponent bids to utility by .
Theorem 5.1.
Let , M be a mechanism, and . Then, it holds with probability for all agents over the draw of datasets of valuation-bid queries,
Proof sketch.
The statement is similar to Theorem 3.2 from Balcan et al. (2019a). The key difference lies in the observation that one can average over the opponents’ bidding distribution instead of the opponents’ prior distribution .
We proceed with the discretization step of our procedure. For this purpose, we assume for some suitable . Let be a -grid for , where the largest distance between any point is bounded by . To bound the error incurred by restricting the search to a finite grid, we assume a certain degree of dispersion, as discussed in Section 4.
Assumption 5.2.
Suppose that for mechanism M and each agent , there exist and a function , such that with probability over the draw of the sets , the following conditions hold:
-
1.
For any valuation , the functions are piecewise -Lipschitz and -dispersed.
-
2.
For any reported , the functions are piecewise -Lipschitz and -dispersed.
The constants and will be properties resulting from the interplay of the utilized mechanism M, the prior distribution , the opponents’ strategy profile , and the number of drawn samples. Under the assumption that the dispersion guarantees hold, we can provide the following guarantee on the ex interim utility loss. The full proof is in Appendix D.
Theorem 5.3.
Let and M be a mechanism. Furthermore, let be a strategy profile. Given that Assumption 5.2 holds for , , and , we have with probability at least over the draw of the datasets for every agent
Proof sketch.
Fix an agent . By the definition of dispersion, we have with probability at least , for all , , and reported valuations with , we have
(5) |
and for all , reported valuations , and with , we have
(6) |
For any , there exists a grid point such that and . We apply Equations 5 and 6 for the grid width and the stretched grid width . The statement follows with an application of Theorem 5.1 and a suitable union bound. ∎
The above result is similar to Theorem 3.5 of Balcan et al. (2019a)—which assumed truthful bidding—with the distinction that we need to ensure the dispersion of the utility functions under the opponents’ bidding distribution. Additionally, it is necessary to consider the potential distortion of the grid under the bidding strategies.
6 Verifying approximate equilibrium under interdependent priors
We present the first, to our knowledge, sampling-based results to verify approximate equilibrium with interdependent prior distributions. We limit our focus to ex ante guarantees.
In this setting, from agent ’s perspective, for two distinct received observations and , he must consider two different conditional prior distributions and . For , a sample from can be interpreted as a draw . However, the probability that there is another such that is zero. Therefore, we cannot implement the sampling step in the same manner as we did in Section 5.
We address this challenge by considering a partition of for each agent . Denote the maximum number of elements in anz partition by . We demonstrate that it is sufficient to assume a constant best-response for each if the conditional distribution does not vary too strongly for , according to an appropriate distance measure over the space of probability distributions. With this premise, we establish that one can group the samples based on . Subsequently, we present our upper bound for the ex ante guarantee by conducting the sampling and discretization step for each .
6.1 Bounding best-response utility differences with constant best-responses
For a from partition , we want to bound the error incurred when limiting bidding to a constant best response for all . To achieve this, it is necessary to limit distance between conditional prior distributions and according to some distance for . In contrast to finite-dimensional Euclidean spaces, different distance functions can induce vastly different topologies on the space of probability distributions over continuous spaces (Gibbs and Su, 2002). Therefore, the selection of an appropriate distance measure for this purpose is crucial.
Common choices in the machine learning literature for measuring distances between probability distributions include the Wasserstein metric (also known as the earth mover’s distance or Kantorovich metric), the total variation metric , and the Kullback-Leibler divergence (also referred to as relative entropy). Let and denote two probability measures over agent ’s observation space . We have the following relationship between these distance measures:
where denotes ’s diameter. The above inequalities can be strict, and there are no constants so that they may hold in the other direction in general (Gibbs and Su, 2002).
The objective is to furnish guarantees using the weakest possible distance measure. Unfortunately, the Wasserstein metric, seems too weak to provide sufficient guarantees for discontinuous utility functions (Villani, 2009). The Kullback-Leibler divergence, despite its appealing properties, can be unbounded, which poses a limitation for establishing practical guarantees. On the other hand, the total variation distance has the advantage of being upper bounded by one, making it a more suitable choice for our purposes. Therefore, we opt for the total variation distance as the measure to base our guarantees upon.
Definition 6.1 (Total variation, Gibbs and Su (2002)).
Let and be two probability measures over and be the Borel--algebra. Then the total variation distance between and is given by .
We leverage a well-known fact that the distance between two integrals over different probability measures can be bounded by the total variation of these measures (Villani, 2009). This principle enables us to bound differences in the ex interim utility function for different observations. For the sake of completeness, we provide a proof for this statement.
Theorem 6.2.
Let and be a bounded function. Furthermore, let and be probability measures over with density functions and . Then, we have
Proof.
The total variation distance is equal to one half of the -distance between the density functions (Tsybakov, 2009, Lemma 2.1), that is, . Therefore, we have
∎
We show next that the error incurred by assuming a constant best-response for all observations from can be controlled, provided the distance between conditional prior distributions and is small enough in terms of the total variation distance for . The full proof is in Appendix E.1.
Theorem 6.3.
Let be a partition of . The difference between a best-response utility over function space to best-responses that are constant for every satisfies
with . If there exists a constant such that for , then , where denotes ’s diameter.
Proof sketch.
Fix an agent and . We leverage Teorem 6.2 to establish a bound of the interim utilities for any
We extend this relation to constant best-responses for all for one of these terms, establishing the bound for a single . We apply the low of total expectation to formulate this relation for step functions of the form . ∎
For each , a meaningful upper bound can be established if is sufficiently small. A weaker, but potentially easier to determine, bound can be given if there exists an such that for . This term is directly related to the diameter of , and thus, to the number of elements in the partition . However, importantly, even if for some the value does not have a bound below one, a non-trivial ex ante upper bound may still be achievable if it does hold for sufficiently many . This makes our results applicable to a wide variety of settings. However, while there are several closed-form solutions available for calculating the total variation distance between continuous probability distributions, determining this distance remains hard in general, marking a limitation of our approach. Nevertheless, the growing interest in the total variation distance for applications within machine learning has spurred recent research efforts. For instance, Nielsen and Sun (2018) proposes methods for upper bounding the total variation distance, offering potential pathways to overcome this challenge.
6.2 A sampling-based bound on the ex ante utility loss via finite precision step functions
In this section, we derive sampling-based estimation bounds for the ex ante utility loss. Theorem 6.3 established that finding a constant best-response for all observations from each element is sufficient. Therefore, we execute the sampling and discretization step for each .
Starting with the sampling step, we categorize the dataset according to the partition , for each agent . For each , we define the conditional samples by
Then, constitutes a dataset of draws from . Denote the complete separation of according to partition by .
One advantage of providing ex ante guarantees, as opposed to ex interim guarantees, is the ability to separate the estimation of the best-response utility from the estimation of the ex ante utility . Therefore, conveniently, we can estimate the ex ante utility using the distribution-independent Hoeffding inequality, eliminating the need to rely on complex concepts such as the pseudo-dimension or partitioning the dataset . The full proof is in Appendix E.3.
Theorem 6.4.
Let be a strategy profile. With probability over the draw of the dataset , we have for every agent
Proof sketch.
We fix an agent and apply Theorem A.4 to with . A union bound over the agents finishes the statement. ∎
It remains to estimate the best-response utility. For this purpose, we continue with the sampling step of our approach. For mechanism M and agent , define the class of functions that map valuations and opponent bids to utility by . The proof of the following theorem is in Appendix E.3.
Theorem 6.5.
With probability over the draw of the sets , for partitions of for every agent , we have
We proceed with the discretization step to identify a constant best-response for each over the bidding space . To this end, we assume for a suitable . For a , denote with a finite -grid. We make the following assumption.
Assumption 6.6.
Suppose that for mechanism M, each agent , and segment , there exist and a function , such that with probability over the draw of the sets , the functions are piecewise -Lipschitz and -dispersed.
Under this assumption, we can provide the following approximation bounds by approximating a best-response over a finite subset of the action space. The proof of the following lemma is conceptually similar to the one of Theorem 5.3 and can be found in Appendix E.3.
Lemma 6.7.
Let , be a strategy profile, and M be a mechanism. Suppose that for each agent and segment , Assumption 6.6 holds for and . Then, with probability over the draw of the sets , agents , and segments ,
7 Guarantees on dispersion and pseudo-dimension for four mechanisms
In this section, we report dispersion and pseudo-dimension guarantees for various mechanisms. These enable us to instantiate the bounds from the previous two sections, thus allowing us to assess the degree to which the empirical utility loss estimates correspond to the true utility losses.
We build upon the work of Balcan et al. (2019a), which offers dispersion and pseudo-dimension guarantees for a range of mechanisms. We demonstrate how to adapt their guarantees to our context—namely strategic bidding and not just for independent priors but also for interdependent priors. We study some of our settings in the body and the rest in the appendix; a detailed summary of all our guarantees can be found in Table 1.
Mechanism |
|
Dispersion guarantees | ||||
---|---|---|---|---|---|---|
First-price single-item auction |
|
|||||
|
|
|||||
|
|
|||||
|
|
7.1 Dispersion guarantees under strategic bidding
To adapt the dispersion guarantees from Balcan et al. (2019a) to our context, two significant modifications are required. First, in situations involving interdependent priors, it is necessary to focus on the conditional prior distribution. Second, one needs to reason about the (conditional) bidding distribution instead of the prior distribution . To address the first challenge, we extend the assumption of -bounded distributions to the conditional prior distribution. We then apply Theorem 4.4 to tackle the second challenge. As a result, a -bounded prior distribution transforms into a -bounded bidding distribution. By making these adjustments, we can apply the dispersion guarantees from Balcan et al. (2019a) to our specific situation with small modifications required in the original proofs. We illustrate how to formulate and extend the dispersion guarantees for the first-price single-item auction. For the detailed statements on other mechanisms, see Appendix B.
First-price single-item auction
In the first-price single-item auction, the item is awarded to the highest bidder, who then pays the amount of its bid. Each agent has a valuation for the item and submits a bid . The utility function for agent is given by . We limit ourselves to present the statement for the interdependent prior case, as it incorporates both changes described above. For the statement with independent prior distributions, see Appendix B.1.
The following theorem asserts Assumption 6.6 is valid for the first-price auction with interdependent prior distributions (Section 6). The full proof is in Appendix B.1.
Theorem 7.1.
Let . Assume that for each agent and segment , there exists , such that the conditional marginal distributions for are bounded. Then, for , with probability at least over the draw of the sets for every and , the functions are piecewise 1-Lipschitz and -dispersed, with .
Proof sketch.
For agent , apply Theorem 4.4 to the marginal bidding distribution . Then, the -bounded density function for every agent and transforms into a -bounded bidding distribution. Next, we determine that for a sample , the discontinuity in the utility functions is located at the point . Following this, we apply standard dispersion results (as detailed in Appendix A.2) to restrict the number of points within any interval of width with high probability. A suitable union bound finishes the statement. ∎
7.2 Pseudo-dimension guarantees via delineability
Balcan et al. (2019a) build their pseudo-dimension guarantees on the concept of -delineability (Balcan et al., 2018b). If one can show that a function class is -delineable, one can bound its pseudo-dimension. Balcan et al. (2019a) show is -delineable for several auction mechanisms to derive their bounds. We extend their statements to by showing if is -delineable, then is -delineable. This way, we can readily extend their pseudo-dimension guarantees. The concept of -delineability is defined as follows.
Definition 7.2 (-delineable, Balcan et al. (2018b)).
Let and a vector-space. A class of functions is -dealineable if for any , there is a set of hyperplanes such that for any connected component of , is linear over .
The following theorem is similar to Balcan et al. (2018b)’s main statement to bound the pseudo-dimension of an -delineable function class. We slightly reformulated it to our setting.
Theorem 7.3 (Balcan et al. (2018b)).
If a function class is -dealineable, then .
We now give our statement that extends the pseudo-dimension results from to .
Theorem 7.4.
Let M be a mechanism and . Suppose the function class is -delineable, then is -delineable.
Proof.
For a , let be an open subset such that is linear in over . As the allocation and the price are independent of , the allocation has to be constant for all , otherwise there would be a jump for a changing . Therefore, is linear in for .
Let . As is -delineable, for , there exists a set of hyperplanes such that for any connected component of the utility is linear for and . Denote with the set of connected components of , where is the number of connected components. For , we need at most hyperplanes so that . By the argument above, the allocation is fixed for for every and is linear in . Therefore, is linear in . Therefore, is -delineable. ∎
Due to space restrictions, we direct readers to Appendix B for thorough descriptions of the mechanisms and the detailed guarantees derived by the approach described above.
8 Conclusions and future research
We introduced sampling-based methods for estimating the distance of a strategy profile from an ex interim or ex ante Bayesian Nash equilibrium. Our approach significantly broadens the scope of approximate equilibrium verification compared to prior methods, which rely on narrow assumptions like truthful bidding, single-item auctions, and/or complete knowledge of the prior. Notably, we enhance the sampling method proposed by Balcan et al. (2019a) by extending it to allow strategic bidding, and correcting their prior assertion regarding its applicability to interdependent priors in the ex ante scenario.
Our key contribution is the development of an empirical estimator for the utility loss, which—intuitively speaking—measures the maximum utility an agent can gain by deviating from its current strategy. We have effectively bounded the error between this empirical estimate and the true utility loss by employing a mixture of learning theory tools such as dispersion and pseudo-dimension. We established sufficient conditions for strategy profiles and a closeness criterion for conditional distributions that ensure that utility gains estimated through our finite subset of the strategy space closely approximate the maximum gains. We thus derived strong guarantees for a broad class of auctions with independent or interdependent priors, including the first-price single-item and combinatorial auction, discriminatory auction, and uniform-price auction.
In related research, we discussed several promising techniques to computationally determine equilibrium candidates in complex auctions. To better understand the implications of our results, a natural next step is to combine equilibrium computation with our method of verification to analyze practically relevant settings.
However, it is important to note that our current bounds on the utility loss scale exponentially with the complexity inherent in general combinatorial auctions. Recognizing this limitation, a valuable avenue for future research involves exploiting the unique structural characteristics of certain combinatorial auctions, such as those involving items that are substitutes or complements. By doing so, there is potential to derive bounds that scale polynomially rather than exponentially with the number of items. This could significantly enhance the efficiency and feasibility of applying our methods to a broader range of auction formats, thereby extending their practical applicability.
References
- Harsanyi [1967] John C. Harsanyi. Games with Incomplete Information Played by “Bayesian” Players, I–III Part I. The Basic Model. Management Science, 14(3):159–182, November 1967.
- Hurwicz [1972] Leonid Hurwicz. On informationally decentralized systems. In Decision and Organization, pages 297–336. North-Holland Pub. Co., Amsterdam, 1972.
- Krishna [2009] Vijay Krishna. Auction Theory. Academic press, 2 edition, 2009.
- Day and Milgrom [2008] Robert Day and Paul Milgrom. Core-selecting package auctions. International Journal of Game Theory, 36(3):393–407, March 2008.
- Rothkopf et al. [1990] Michael H. Rothkopf, Thomas J. Teisberg, and Edward P. Kahn. Why Are Vickrey Auctions Rare? Journal of Political Economy, 98(1):94–109, 1990.
- Sandholm [2000] Tuomas Sandholm. Issues in computational Vickrey auctions. International Journal of Electronic Commerce, 4(3):107–129, 2000. Early version in ICMAS-96.
- Larson and Sandholm [2001] Kate Larson and Tuomas Sandholm. Costly valuation computation in auctions. In Theoretical Aspects of Rationality and Knowledge (TARK VIII), pages 169–182, Siena, Italy, July 2001.
- Vickrey [1961] William Vickrey. Counterspeculation, Auctions, and Competitive Sealed Tenders. The Journal of Finance, 16(1):8–37, 1961.
- Clarke [1971] Edward Clarke. Multipart pricing of public goods. Public Choice, 11(1):17–33, 1971.
- Groves [1973] Theodore Groves. Incentives in Teams. Econometrica, 41(4):617–631, 1973.
- Conitzer and Sandholm [2006] Vincent Conitzer and Tuomas Sandholm. Failures of the VCG mechanism in combinatorial auctions and exchanges. In Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pages 521–528, Hakodate, Japan, 2006.
- Ausubel and Milgrom [2006] Lawrence M. Ausubel and Paul Milgrom. The Lovely but Lonely Vickrey Auction. In Combinatorial Auctions, pages 17–40. MIT Press, 2006.
- Gilpin and Sandholm [2004] Andrew Gilpin and Tuomas Sandholm. Arbitrage in combinatorial exchanges. In Agent-Mediated Electronic Commerce (AMEC) workshop, pages 43–56, New York, NY, 2004.
- Sandholm [2013] Tuomas Sandholm. Very-Large-Scale Generalized Combinatorial Multi-Attribute Auctions. In Nir Vulkan, Alvin E. Roth, and Zvika Neeman, editors, The Handbook of Market Design, pages 379–412. Oxford University Press, September 2013.
- Athey [2001] Susan Athey. Single crossing properties and the existence of pure strategy equilibria in games of incomplete information. Econometrica, 69(4):861–889, July 2001.
- Reny [2020] Philip J. Reny. Nash Equilibrium in Discontinuous Games. Annual Review of Economics, 12(1):439–470, 2020.
- Bosshard et al. [2020] Vitor Bosshard, Benedikt Bünz, Benjamin Lubin, and Sven Seuken. Computing Bayes-Nash Equilibria in Combinatorial Auctions with Verification. Journal of Artificial Intelligence Research (JAIR), 69:531–570, 2020.
- Bichler et al. [2021] Martin Bichler, Maximilian Fichtl, Stefan Heidekrüger, Nils Kohring, and Paul Sutterer. Learning equilibria in symmetric auction games using artificial neural networks. Nature Machine Intelligence, 3(8):687–695, August 2021.
- Bichler et al. [2023a] Martin Bichler, Nils Kohring, and Stefan Heidekrüger. Learning Equilibria in Asymmetric Auction Games. INFORMS Journal on Computing, 35(3):523–542, May 2023a.
- Bichler et al. [2023b] Martin Bichler, Max Fichtl, and Matthias Oberlechner. Computing Bayes–Nash Equilibrium Strategies in Auction Games via Simultaneous Online Dual Averaging. Operations Research, December 2023b.
- Balcan et al. [2019a] Maria-Florina Balcan, Tuomas Sandholm, and Ellen Vitercik. Estimating Approximate Incentive Compatibility. arXiv e-prints, page arXiv:1902.09413v3 [cs.GT], February 2019a.
- Reny [2011] Philip J. Reny. On the Existence of Monotone Pure-Strategy Equilibria in Bayesian Games. Econometrica, 79(2):499–553, 2011.
- Balcan et al. [2019b] Maria-Florina Balcan, Tuomas Sandholm, and Ellen Vitercik. Estimating Approximate Incentive Compatibility. arXiv e-prints, page arXiv:1902.09413v4 [cs.GT], February 2019b.
- Balcan et al. [2018a] Maria-Florina Balcan, Travis Dick, and Ellen Vitercik. Dispersion for Data-Driven Algorithm Design, Online Learning, and Private Optimization. In Annual Symposium on Foundations of Computer Science (FOCS). IEEE, October 2018a.
- Pollard [1984] David Pollard. Convergence of Stochastic Processes. Springer Series in Statistics. Springer, New York, NY, 1984.
- Shi and Littman [2000] Jiefu Shi and Michael Littman. Abstraction methods for game theoretic poker. In CG ’00: Revised Papers from the Second International Conference on Computers and Games, pages 333–345, London, UK, 2000. Springer-Verlag.
- Billings et al. [2003] Darse Billings, Neil Burch, Aaron Davidson, Robert Holte, Jonathan Schaeffer, Terence Schauenberg, and Duane Szafron. Approximating game-theoretic optimal strategies for full-scale poker. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2003.
- Gilpin and Sandholm [2006] Andrew Gilpin and Tuomas Sandholm. A competitive Texas Hold’em poker player via automated abstraction and real-time equilibrium computation. In Proceedings of the National Conference on Artificial Intelligence (AAAI), pages 1007–1013, 2006.
- Bowling et al. [2015] Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin. Heads-up limit hold’em poker is solved. Science, 347(6218), January 2015.
- Brown and Sandholm [2018] Noam Brown and Tuomas Sandholm. Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science, 359(6374):418–424, 2018. Appeared online in Science in 2017.
- Brown and Sandholm [2019] Noam Brown and Tuomas Sandholm. Superhuman AI for multiplayer poker. Science, 365(6456):885–890, 2019.
- Waugh et al. [2009] Kevin Waugh, David Schnizlein, Michael H. Bowling, and Duane Szafron. Abstraction pathologies in extensive games. In International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2009, Budapest, Hungary, May 2009.
- Gilpin and Sandholm [2007] Andrew Gilpin and Tuomas Sandholm. Lossless abstraction of imperfect information games. Journal of the ACM, 54(5), 2007.
- Sandholm and Singh [2012] Tuomas Sandholm and Satinder Singh. Lossy stochastic game abstraction with bounds. In Proceedings of the ACM Conference on Electronic Commerce (EC), 2012.
- Kroer and Sandholm [2014] Christian Kroer and Tuomas Sandholm. Extensive-form game abstraction with bounds. In Proceedings of the ACM Conference on Economics and Computation (EC), 2014.
- Kroer and Sandholm [2016] Christian Kroer and Tuomas Sandholm. Imperfect-recall abstractions with bounds in games. In Proceedings of the ACM Conference on Economics and Computation (EC), 2016.
- Kroer and Sandholm [2018] Christian Kroer and Tuomas Sandholm. A unified framework for extensive-form game abstraction with bounds. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), 2018.
- Kroer and Sandholm [2015] Christian Kroer and Tuomas Sandholm. Discretization of continuous action spaces in extensive-form games. In Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), 2015.
- Pieroth et al. [2023] Fabian R. Pieroth, Nils Kohring, and Martin Bichler. Equilibrium Computation in Multi-Stage Auctions and Contests. arXiv e-prints, page arXiv:2312.11751 [cs.GT], December 2023.
- Kohring et al. [2023] Nils Kohring, Fabian R. Pieroth, and Martin Bichler. Enabling First-Order Gradient-Based Learning for Equilibrium Computation in Markets. In International Conference on Machine Learning (IMCL), 2023, Honolulu, Hawaii, July 2023.
- Timbers et al. [2020] Finbarr Timbers, Nolan Bard, Edward Lockhart, Marc Lanctot, Martin Schmid, Neil Burch, Julian Schrittwieser, Thomas Hubert, and Michael Bowling. Approximate exploitability: Learning a best response in large games. arXiv e-prints, page arXiv:2004.09677 [cs.LG], April 2020.
- Golowich et al. [2018] Noah Golowich, Harikrishna Narasimhan, and David C. Parkes. Deep learning for multi-facility location mechanism design. In International Joint Conference on Artificial Intelligence (IJCAI), 2018, Stockholm, Sweden, July 2018.
- Feng et al. [2018] Zhe Feng, Harikrishna Narasimhan, and David C Parkes. Deep learning for revenue-optimal auctions with budgets. In International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2018, Richland, SC, 2018. International Foundation for Autonomous Agents and Multiagent Systems.
- Duetting et al. [2019] Paul Duetting, Zhe Feng, Harikrishna Narasimhan, David Parkes, and Sai Srivatsa Ravindranath. Optimal Auctions through Deep Learning. In International Conference on Machine Learning (ICML), 2019, May 2019.
- Curry et al. [2020] Michael Curry, Ping-yeh Chiang, Tom Goldstein, and John Dickerson. Certifying Strategyproof Auction Networks. In Advances in Neural Information Processing Systems (NeurIPS), 2020, 2020.
- Curry et al. [2023] Michael J. Curry, Tuomas Sandholm, and John P. Dickerson. Differentiable economics for randomized affine maximizer auctions. In International Joint Conference on Artificial Intelligence (IJCAI) 2023, Macao, SAR, China, August 2023.
- Srinivasan et al. [2018] Sriram Srinivasan, Marc Lanctot, Vinícius Flores Zambaldi, Julien Pérolat, Karl Tuyls, Rémi Munos, and Michael Bowling. Actor-critic policy optimization in partially observable multiagent environments. In Conference on Neural Information Processing Systems (NeurIPS), 2018, Montréal, Canada, December 2018.
- Brown et al. [2019] Noam Brown, Adam Lerer, Sam Gross, and Tuomas Sandholm. Deep counterfactual regret minimization. In Proceedings of the International Conference on Machine Learning (ICML), 2019.
- Mohri et al. [2012] Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar. Foundations of Machine Learning. Adaptive Computation and Machine Learning. MIT Press, 2012.
- Verine et al. [2023] Alexandre Verine, Benjamin Negrevergne, Yann Chevaleyre, and Fabrice Rossi. On the expressivity of bi-Lipschitz normalizing flows. In Asian Conference on Machine Learning, April 2023.
- Lubin and Parkes [2012] Benjamin Lubin and David C. Parkes. Approximate strategyproofness. Current Science, 103(9):1021–1032, 2012.
- Azevedo and Budish [2019] Eduardo M. Azevedo and Eric Budish. Strategy-proofness in the Large. The Review of Economic Studies, 86(1 (306)):81–116, 2019.
- Hart and Nisan [2012] Sergiu Hart and Noam Nisan. Approximate revenue maximization with multiple items. In ACM Conference on Electronic Commerce (ACM-EC), 2012, New York, NY, USA, June 2012.
- Chawla and Hartline [2013] Shuchi Chawla and Jason D. Hartline. Auctions with unique equilibria. In Proceedings of the ACM Conference on Electronic Commerce (ACM-EC), 2013, EC ’13, pages 181–196, New York, NY, USA, June 2013. Association for Computing Machinery.
- Gibbs and Su [2002] Alison L. Gibbs and Francis Edward Su. On Choosing and Bounding Probability Metrics. International Statistical Review / Revue Internationale de Statistique, 70(3):419–435, 2002.
- Villani [2009] Cédric Villani. Optimal Transport, volume 338 of Grundlehren Der Mathematischen Wissenschaften. Springer, Berlin, Heidelberg, 2009.
- Tsybakov [2009] Alexandre Tsybakov. Introduction to Nonparametric Estimation. January 2009.
- Nielsen and Sun [2018] Frank Nielsen and Ke Sun. Guaranteed Deterministic Bounds on the total variation Distance between univariate mixtures. In International Workshop on Machine Learning for Signal Processing (MLSP), 2018, pages 1–6, Aalborg, Denmark, September 2018. IEEE.
- Balcan et al. [2018b] Maria-Florina Balcan, Tuomas Sandholm, and Ellen Vitercik. A general theory of sample complexity for multi-item profit maximization. In Conference on Economics and Computation (EC), 2018, Ithaca, NY, USA, June 2018b. ACM.
- Federer [1996] Herbert Federer. Geometric Measure Theory. Classics in Mathematics. Springer Berlin Heidelberg, Berlin, Heidelberg, 1996.
- Hoeffding [1963] Wassily Hoeffding. Probability Inequalities for Sums of Bounded Random Variables. Journal of the American Statistical Association, 58(301):13–30, 1963.
Appendix A Auxiliary lemmas and results
In this section, we introduce some helpful concepts to proof our results.
A.1 Bi-Lipschitz continuous functions
We revisit some well-established results from existing literature.
Formally, the restrictions on the rate of change for a bi-Lipschitz mapping are captured by the following bounds on the determinant of its Jacobian matrix. This is presented in the following lemma.
Lemma A.1 (Verine et al. [2023], Federer [1996]).
Let be a -bi-Lipschitz function. Then, for all it holds that
The change of variables formula serves as a foundational tool in our analysis, permitting the expression of the density function of a probability measure under a mapping that exhibits sufficient regularity, such as bi-Lipschitz maps. We consider the following version of the well-known change of variables formula.
Theorem A.2 (Change of Variables, Villani [2009, p.12]).
Let be open, bounded, and connected subsets. Let be two probability measures on and , respectively, that are absolutely continuous with respect to the Borel-measure . Let be an injective, locally Lipschitz function such that is the pushforward measure of under , that is, . Then, it holds that
where denote the density functions of and , respectively, and denotes the Jacobian matrix of .
Lemma A.3.
Let and be a -bi-Lipschitz function. Furthermore, let be a probability measure over with a -bounded density function , i.e., . Then, the push-forward probability measure has a -bounded density function
Proof.
We start by using the change of variables formula from Theorem A.2. Let and . Then, we get for and
∎
A.2 Generic dispersion statements
We present several generic dispersion lemmas based on the work by Balcan et al. [2018a], refining some of their statements to provide explicit guarantees rather than presenting results in big notation. This refinement requires minor adjustments to their proofs. However, first we introduce the Hoeffding inequality, which is another well-known concentration bound. It provides a distribution-independent concentration bound, enabling an accurate sampling-based estimation of the expectation of a single random variable.
Theorem A.4 (Hoeffding [1963]).
Let be i.i.d. random variables over . Then, with probability at least ,
We restate a well-known folklore lemma next, providing explicit bounds for uniform convergence for non-identical random variables. This is supported by well-established results regarding Rademacher complexity and the VC-dimension [Mohri et al., 2012].
Lemma A.5 (Balcan et al. [2018a, Lemma 2, p.23]).
Let be a set of random variables where . For any , with probability at least over the draw of the set ,
where is another sample drawn from .
Proof.
Let be an -dimensional vector of Rademacher random variables. The empirical Rademacher complexity is given by
where denotes the set of indicator functions over intervals. The empirical Rademacher complexity can be bounded via the VC-dimension by
which uses Corollary 3.1 and 3.3 by Mohri et al. [2012], and that we can bound the empirical Rademacher complexity by the Rademacher complexity for distribution-independent bounds. Therefore,
(7) |
Following the proof by Balcan et al. [2018a, Lemma 2, p.23], we derive
(8) |
and
(9) |
Combining the results up until now results in
∎
To prove dispersion we will use the following probabilistic lemma, showing that samples from -bounded distributions do not tightly concentrate.
Lemma A.6 (Balcan et al. [2018a, Lemma 1, p.23]).
Let be a collection of samples where each is drawn from a -bounded distribution with density function . For any , the following statements hold with probability at least :
-
1.
If the are independent, then every interval of width contains at most samples.
-
2.
If the samples can be partitioned into buckets such that each contains independent samples and , then every interval of width contains at most samples.
Proof.
We consider Part 1 first. The expected number of samples that land in an interval of width is at most , since the probability that is bounded by . By Lemma A.5, we have that with probability at least over the draw of the set ,
(10) |
where is another sample from . The number of elements in an interval satisfies
(11) |
Combining Equations 10 and 11 implies that with probability of at least , every interval of width satisfies .
Part 2 follows by applying Part 1 to each bucket and taking a union bound over the buckets. ∎
Appendix B Dispersion and pseudo-dimension guarantees
We provide detailed statements regarding the dispersion and pseudo-dimension guarantees for several mechanisms. The descriptions of these market mechanisms are adapted from Balcan et al. [2019a].
B.1 First-price single-item auction
In the first-price auction, the item is awarded to the highest bidder, who then pays the amount of its bid. Each agent has a valuation for the item and submits a bid . The utility function for agent is given by , where denotes the highest bid among the other bidders.
In the context of independent prior distributions (Section 5), we show Assumption 5.2 is satisfied with the following statement.
Theorem B.1.
Assume every agent has a -bounded marginal prior distribution . Let be a strategy profile of bi-Lipschitz bidding strategies. With probability for all agents over the draw of the datasets ,
-
1.
For any , the functions are piecewise -Lipschitz and -dispersed with .
-
2.
For any and , the function is -Lipschitz continuous.
Proof.
We start with the first part of the statement. Consider and arbitrary. For any and bid , we have . Therefore, if , then is a constant function in . On the other hand, if , then is linear in with slope of . Consequently, we have for all and , the function is piecewise -Lipschitz continuous with a discontinuity at .
We proceed with the dispersion constants . As discussed previously, the function can only have a discontinuity at a point in the set . Therefore, it is sufficient to guarantee with probability , at most points in the set fall within an interval of width . The statement then follows over a union bound over the bidders. We apply Lemma A.6 in Appendix A.2 to show this statement. For , define . Then, within each , the samples are independently drawn from the bidding distribution . Per assumption, the marginal prior is a -bounded distribution. By Theorem 4.4, the bidding distribution’s density function satisfies . Therefore, the samples are drawn from a -bounded distribution. Therefore, with probability at most every interval of width contains at most
The second statement can be seen as follows. For any given bids , the allocation is fixed. Therefore, is either constant if or linear with slope if . ∎
Theorem 7.1.
Let . Assume that for each agent and segment , there exists , such that the conditional marginal distributions for are bounded. Then, for , with probability at least over the draw of the sets for every and , the functions are piecewise 1-Lipschitz and -dispersed, with .
Proof.
We start with the first part of the statement. Consider and arbitrary. For any and bid , we have . Therefore, if , then is a constant function in . On the other hand, if , then is linear in with slope of . Consequently, we have for all , the function is piecewise -Lipschitz continuous with a discontinuity at .
Fix agent and . For any and , the function can only have a discontinuity at a point in the set . Therefore, it is sufficient to guarantee with probability at least , at most points in the set fall within any interval of width . The statement then follows over a union bound over the -bidders and up to segments.
We apply Lemma A.6. For define . Within each , the samples are independently drawn from the marginal conditional bidding distribution . Per assumption, is a -bounded distribution. By Theorem 4.4, the conditional bidding distribution’s density function satisfies . The samples for are drawn from a -bounded distribution. Therefore, with probability at most any interval of width contains at most
∎
Theorem B.2 (Balcan et al. [2019a, Theorem 3.9]).
for all .
B.2 First-price combinatorial auction
There are items for sale. An agent’s valuation space is represented by , indicating its value for each possible bundle . The valuation and bid for a bundle are denoted by and , respectively. The allocation is determined as the solution to the winner determination problem:
The price for agent is then given by .
We start with the dispersion guarantees.
Theorem B.3.
Let . Assume that for each pair of agents and each pair of bundles , the joint marginal prior distribution is -bounded. With probability for all agents over the draw of the datasets ,
-
1.
For any , the functions are piecewise -Lipschitz and -dispersed.
-
2.
For any and , the function is -Lipschitz continuous.
Proof.
For the first statement, apply Theorem 4.4 to the joint marginal bidding distribution . Then, the -bounded density function for every pair of agents and for all bundles transforms into a -bounded bidding distribution. Form this point onward, the proof for the first statement follows analogously to the proof of Theorem 3.10 of Balcan et al. [2019a]. The second statement is a direct consequence of Theorem 3.11 from Balcan et al. [2019a]. ∎
Theorem B.4.
Let . Assume that for each agent and each pair of agents , each pair of bundles , and segment , the joint marginal prior distribution is -bounded.
Then, with probability at least over the draw of the sets for every and , the functions are piecewise 1-Lipschitz and
-dispersed.
Proof.
For agent , we apply Theorem 4.4 to the joint marginal bidding distribution . Then, the -bounded density function for every pair of agents , for all bundles , and , transforms into a -bounded bidding distribution. From this point onward, the proof follows analogously to the proof of Theorem 3.10 of Balcan et al. [2019a]. ∎
Theorem B.5 (Balcan et al. [2019a, Theorem 3.12]).
For any agent , the pseudo-dimension of the function class is .
Theorem B.6.
For any agent , the pseudo-dimension of the function class is .
B.3 Discriminatory auction
In the discriminatory auction model, identical units of an item are for sale, with each agent having a valuation vector , indicating its willingness to pay for each additional unit. The valuation decreases with each additional unit, implying . In total bids for and are submitted to the auctioneer. If of agent ’s bids are among the highest, it receives the units at its bid price, paying a cumulative amount based on the quantity awarded, i.e., .
Theorem B.7.
Let . Assume that for each agent and unit , the marginal prior distribution is -bounded. With probability for all agents over the draw of the datasets ,
-
1.
For any , the functions are piecewise -Lipschitz and -dispersed.
-
2.
For any and , the function is -Lipschitz continuous.
Proof.
For the first statement, we apply Theorem 4.4 to the marginal bidding distribution . Then, the -bounded density function for agent and for units transforms into a -bounded bidding distribution. Form this point onward, the proof for the first statement follows analogously to the proof of Theorem 3.16 of Balcan et al. [2019a]. The second statement is a direct consequence of Theorem 3.17 from Balcan et al. [2019a]. ∎
Theorem B.8.
Let . Assume that for each agent , agent , unit , and segment , the marginal prior distribution is -bounded. Then, with probability at least over the draw of the sets for every and , the functions are piecewise 1-Lipschitz and -dispersed.
Proof.
For agent , apply Theorem 4.4 to the marginal bidding distribution . Then, the -bounded density function for every agent , every unit , and transforms into a -bounded bidding distribution. Form this point onward, the proof for the first statement follows analogously to the proof of Theorem 3.16 of Balcan et al. [2019a]. ∎
Theorem B.9 (Balcan et al. [2019a, Theorem 3.18]).
For any agent , we have is .
Theorem B.10.
For any agent , the pseudo-dimension of the function class is .
B.4 Uniform-price auction
In the uniform-price auction model, the allocation mechanism parallels that of the discriminatory auction (Section B.3). The uniform-price auction sells all units at a market-clearing price, with demand meeting supply. Following the principle that the market-clearing price is the highest bid not resulting in a sale [Krishna, 2009], we define as the array of the top competing bids against agent , ordered in descending value. This means is the highest of the opponents’ bids, is the second-highest, and so on. Agent secures exactly one unit if and only if its highest bid surpasses the lowest winning bid and its second-highest bid does not exceed the second-lowest winning bid, i.e., and . This condition extends to multiple units where agent wins exactly units if its th bid exceeds the corresponding winning bid and the next highest bid does not. The market-clearing price is set to , which is the maximum of the lowest winning bid and the highest losing bid. The final payment by agent is .
Theorem B.11.
Let . Assume that for each agent and unit , the marginal prior distribution is -bounded. With probability for all agents over the draw of the datasets ,
-
1.
For any , the functions are piecewise -Lipschitz and -dispersed.
-
2.
For any and , the function is -Lipschitz continuous.
Proof.
For the first statement, apply Theorem 4.4 to the marginal bidding distribution . Then, the -bounded density function for agent and for units transforms into a -bounded bidding distribution. Form this point onward, the proof for the first statement follows analogously to the remaining proof of Theorem D.5 of Balcan et al. [2019a]. The second statement is a direct consequence of Theorem D.6 from Balcan et al. [2019a]. ∎
Theorem B.12.
Let . Assume that for each agent , agent , unit , and segment , the marginal prior distribution is -bounded. Then, with probability at least over the draw of the sets for every and , the functions are piecewise 1-Lipschitz and -dispersed.
Proof.
For agent , apply Theorem 4.4 to the marginal bidding distribution . Then, the -bounded density function for every agent , every unit , and transforms into a -bounded bidding distribution. Form this point onward, the proof for the first statement follows analogously to the proof of Theorem D.5 of Balcan et al. [2019a]. ∎
Theorem B.13 (Balcan et al. [2019a, Theorem D.7]).
For any agent , is .
Theorem B.14.
For any agent , the pseudo-dimension of the function class is .
Appendix C Proofs to limit concentration of bidding distributions Section 4
Theorem 4.4.
Denote with and the density functions for the marginal prior distributions and for any . Further assume that and are -bounded density functions for some . Further, let be a strategy profile of bi-Lipschitz continuous bidding strategies. Then, the probability density functions of the bidding distributions and satisfy
where denotes the dimension of .
Proof.
By the definition of bi-Lipschitz continuity, the function is invertible for any . We perform a change of variables (Theorem A.2) with and . Then, we have for
where denotes the dimension of . We used a well-known bound on a bi-Lipschitz mapping’s Jacobian determinant in the last step.
For with , the functions and are independent from one another. That is, and . The same holds for their inverses, so that the Jacobian matrix of is a block matrix. That is, for and
A well-known fact about the determinant of a block-matrix is that it equals the product of the blocks’ determinants. By another application of the change of variables formula, we have
∎
Appendix D Proofs for independent prior distributions Section 5
Theorem 5.1.
Let , M be a mechanism, and a strategy profile. Then, it holds with probability for all agents over the draw of datasets of valuation-bid queries,
Proof.
Fix an arbitrary agent . Then we have with that is i.i.d. for . Therefore, by applying Theorem 3.3, we have with probability at least for all that
As this holds for all , we have with probability
Denote the event that the previous inequalities hold for agent by . Then, we have shown so far. It remains to show the bounds hold for all agents. We apply a union bound to the events , which gives
∎
Theorem 5.3.
Let and M be a mechanism. Furthermore, let be a strategy profile. Given that Assumption 5.2 holds for , , and , we have with probability at least over the draw of the datasets for every agent
Proof.
For a -dispersed set of functions, with probability , at most jump discontinuities fall within a ball of radius . Therefore, within any ball of radius , at least functions are Lipschitz continuous, and at most are not. Let and be the function from the dispersion guarantees from Assumption 5.2. Define . Then, with probability at least , the following conditions hold:
-
1.
For all , valuations , and reported valuations with , we have
(12) -
2.
For all , reported valuations , and valuations with , we have
(13)
Let . By the definition of , there exist points such that and . Equation 13 results in
and
Equation 12 gives
Due to the Lipschitz continuity of , we have . An additional application of Assumption 5.2 and Equation 12 gives with probability at least
Therefore, combining these statements, we have with probability at least
The statement is complete with an additional application of Theorem 5.1. That is, in total, three different events with probability need to hold. The first comes from the pseudo-dimension concentration bound of Theorem 5.1. The two other events are the dispersion guarantees from Assumption 5.2 for balls of width and . The combination of these statements gives with probability at least
∎
Appendix E Proofs for interdependent prior distributions Section 6
This section provides the detailed proofs for the error bounds in approximating the ex ante utility loss for interdependent prior distributions.
E.1 Proof of Theorem 6.3
The partition determines which segments of the observation space can be considered collectively. For each element within , we identify a constant best-response. We show that the error made by this procedure can be bounded in terms of the total variation distance between prior distributions conditioned on observations from . We show this for a single segment first.
Lemma E.1.
Let and be an opponent strategy profile for agent . Then one can bound the largest difference of the ex interim best-response utility and the utility of a constant best-response over by
Furthermore, the difference between a best-response over the set of bidding functions restricted to and a constant best-response is bounded by
Proof.
Let and . Choose such that it is within of the best-response utility, that is,
(14) |
Then,
(15) |
As and were chosen arbitrarily, the first statement follows.
For the second statement, observe that the best-response ex ante utility over is bounded by the largest ex interim best-response utility over . More specifically,
(16) |
Therefore, using the first statement, we get
∎
The previous lemma indicates that the error incurred by employing a constant best-response, as opposed to a functional one over a set , can be managed provided that the conditional distribution does not change too much. This simplifies the utility loss estimation process considerably, as the error introduced by constant best-responses can be bounded by the maximum total variation distance of the conditional distributions for observations from . The following theorem expands upon this result, applying it across the entire partition of .
Theorem 6.3.
Let be a partition of . The difference between a best-response utility over function space to best-responses that are constant for every satisfies
with . If there exists a constant such that for , then , where denotes ’s diameter.
Proof.
Let . Then, there exists a unique such that . The error between the ex interim best-response utility and the constant best-response utility over can be bounded by
We rewrite the best-response ex ante utilities using the law of total expectation. For the first term follows
where denotes the restriction of the bidding strategies to . We have for the second term
Combing these two transformations gives
For arbitrary , we have . Therefore, if there exists a constant such that for , then . ∎
E.2 Proof of Theorems 6.4 and 6.5
Theorem 6.4.
Let be a strategy profile. With probability over the draw of the dataset , we have for every agent
Proof.
Fix an agent . with is a random variable with a distribution over .
The values are i.i.d. samples from this distribution with coming from the dataset for . By applying Hoeffding’s inequality (Theorem A.4), we get with probability at least
The statement follows by applying a union bound over the set of agents . ∎
Theorem 6.5.
With probability over the draw of the sets , for partitions of for every agent , we have
Proof.
Fix an agent and a segment . Note that we can write the ex ante utility given the event and bid as
By Theorem 3.3, we get that with probability at least over the draw of for all ,
Since this holds for all , we get the statement for the choice of and . Taking a union bound over all and segments yields the final statement. ∎
E.3 Proof of Theorem 6.8
Lemma 6.7.
Let , be a strategy profile, and M be a mechanism. Suppose that for each agent and segment , Assumption 6.6 holds for and . Then, with probability over the draw of the sets , agents , and segments ,
Proof.
Fix agent and . Let with . When considering the following difference for a specific
(17) |
then, either is -Lipschitz continuous over or there is a jump discontinuity. In the first case, we can bound the difference in Equation 17 by , and in the second, we can bound it by . While the second bound is trivial, dispersion guarantees that with high probability this case can happen at most times. Therefore, by the definition of dispersion, we know that with probability over the draw of the sets , for mechanism M, agents , and segments , we have for all with that
Let be arbitrary. By the definition of , there must be a point such that . Therefore, with probability
∎
Lemma E.2.
Let for every agent , be a partition of , , and . Then, with probability at least over the draw of the dataset , we have for all agents
Proof.
Fix an agent . Define the random variable , where . As is a partition and , we know . We have with probability
where we used the Hoeffding inequality on the for i.i.d. draws of the random variable . A union bound over the agents completes the proof. ∎
Theorem 6.8.
Proof.
Fix . The ex ante utility loss consists of the best-response utility and the ex ante utility of the strategy profile . We start by approximating the ex ante utility of . By Theorem 6.4, with probability over the draw of the dataset
(18) |
Let’s consider the estimation error to the best-response utility next. We can rewrite the best-response ex ante utility to
The inner terms, i.e., the difference of the best-response ex ante utility to our estimator over each , can be bounded by
(19) |
This can be seen by noting that the estimator on the right is bounded below by zero because an agent can guarantee not to be worse off than not participating by bidding the minimal amount. Therefore, we can bound the estimation error for each by one in the worst-case. A more meaningful upper bound to the estimation error for the best-response utility can be given by considering four approximation steps. The first one is to consider constant best-responses over a part of the observation space. By Theorem 6.3, we have
(20) |
The second step is to maximize the empirical mean instead of the expectation. By Theorem 6.5, we have with probability over the draw of the datasets , for all agents and segments ,
(21) |
The third step to enable a search for a best-response is to consider a finite grid over , leveraging the concept of dispersion for guarantees. By Lemma 6.7, we have with probability over the draw of the datasets , for all agents and segments ,
(22) |
The fourth approximation step bound the error made by estimation the marginal probabilities by . For this, define
Then, we have for every . By applying Lemma E.2, we have with probability at least
(23) |
We combine the above results to give the full statement. We apply Equation 18 to estimate the ex ante utility under strategy profile . To estimate the best-response utility for each , we either apply Equation 19 for a trivial bound of one or combine Equations 21 and 22 for a potentially stronger upper bound. Finally, we use Equation 23 to justify the estimation of the marginal probabilities for every . In total, each of the four equations holds with probability . By applying a union bound, all four equations hold with probability . Therefore, by additionally applying Equation 20, we have with probability over the draw of the sets and , for mechanism M, agents , and segments ,
∎