Technical Report: Coopetition in Heterogeneous Cross-Silo Federated Learning
Abstract
In cross-silo federated learning (FL), companies collaboratively train a shared global model without sharing heterogeneous data. Prior related work focused on algorithm development to tackle data heterogeneity. However, the dual problem of coopetition, i.e., FL collaboration and market competition, remains under-explored. This paper studies the FL coopetition using a dynamic two-period game model. In period 1, an incumbent company trains a local model and provides model-based services at a chosen price to users. In period 2, an entrant company enters, and both companies decide whether to engage in FL collaboration and then compete in selling model-based services at different prices to users. Analyzing the two-period game is challenging due to data heterogeneity, and that the incumbent’s period one pricing has a temporal impact on coopetition in period 2, resulting in a non-concave problem. To address this issue, we decompose the problem into several concave sub-problems and develop an algorithm that achieves a global optimum. Numerical results on three public datasets show two interesting insights. First, FL training brings model performance gain as well as competition loss, and collaboration occurs only when the performance gain outweighs the loss. Second, data heterogeneity can incentivize the incumbent to limit market penetration in period 1 and promote price competition in period 2.
123
1 Introduction
Cross-silo federated learning (FL) is a distributed machine learning paradigm where multiple companies or organizations train a shared model collaboratively without directly exchanging local data [11]. Typically, the process involves each participant training a local model on their dataset and then sharing model updates with a coordinating server that aggregates these updates to improve a global model. This local training and aggregation iteration continues until the global model converges [10]. Potential application scenarios for cross-silo FL are abundant [7]. For example, in healthcare, hospitals can collaborate on medical research (e.g., disease diagnosis) without sharing sensitive patient data. In finance, different banks can use FL for improved fraud detection without exposing customer data. In smart manufacturing, companies can enhance predictive maintenance without revealing proprietary operational data.
While a significant volume of recent research has focused on improving the model performance in cross-silo FL (e.g., [42, 19, 21]), the critical aspect of market competition remains less explored. In practice, companies can utilize the shared global model developed through FL to offer model-based services, hence competing for the same pool of potential users [40]. This competition can manifest across various industries. In healthcare, hospitals may compete to attract patients by offering diagnostic services or personalized treatment plans. In finance, banks might leverage an enhanced fraud detection system to attract customers by offering greater security and reduced risk of fraud. In smart manufacturing, companies could use the shared global model to optimize operations and attract clients/partnerships via more efficient production services. The dual focus of FL collaboration and market competition is termed as FL coopetition, which is the focus of this paper.
![Refer to caption](x1.png)
While a few recent studies looked at FL coopetition [9, 34, 38, 40], they focused on static competition and overlooked the important aspect of dynamic market entry. Market entrant usually serves as a catalyst for technology innovation (e.g., model and algorithm development in cross-silo FL) and helps provide insights into the interactions between incumbents and entrants [2]. This also impacts the socioeconomic landscape by promoting coopetition and increasing the quality of services (via FL) available to users in the market.
In this paper, we study FL coopetition using a dynamic market entry model that spans two time periods involving three entities: users, an incumbent company, and an entrant company (see Fig. 1):
-
•
Period 1: Only an incumbent company exists in the market, providing users with the model-based service. For example, consider a healthcare provider that has developed a new AI-based tool for early diagnosis of a specific disease and is the only service provider in the market. The company trains a local model on its dataset and offers services to patients at a chosen price.
-
•
Period 2: An entrant company enters the market and coexists with the incumbent in providing user services. The incumbent and the entrant need to decide strategically on whether to engage in FL collaboration. If they collaborate, they will use a jointly developed global model to enhance and offer their diagnostic services. If they opt against collaboration, each will continue using individually trained models. In addition, since users can now choose between different service providers, there is a price competition between the incumbent and the entrant.
Given this dynamic model of FL coopetition, our first question is:
Question 1.
Will the incumbent collaborate with the entrant via FL in the presence of competition?
To answer Question 1, we model the FL collaboration and market competition as two (intertwined) games between the incumbent and the entrant. Each company aims to maximize its profit (from selling model-based services to users). We are interested in solving the game-theoretical equilibrium, which is highly non-trivial due to two reasons. First, companies in practice are heterogeneous regarding their data distributions and quantities [28]. Second, users may exhibit heterogeneous preferences towards companies’ services (even if the services have similar qualities). This can happen when some users find that a particular company’s service matches more closely with their individual characteristics, e.g., demographic profiles and personal attributes [25]. It is challenging to analyze (or even model) the game. To address this issue, we resort to the renowned Hotelling model in economics [3] and generalize it to model various types of heterogeneity. We characterized the equilibrium with arbitrary data distributions/quantities of companies and under minor assumptions about users’ preferences.
Among aforementioned heterogeneity types, data heterogeneity receives the most research attention from the FL community and continues to be the major bottleneck [41]. There are many excellent studies on algorithm development to mitigate the client drift issue caused by data heterogeneity, e.g., [15, 16, 31, 17]. We will show that our model and analysis are orthogonal to any FL algorithms. Since we focus on FL coopetition, our second key question is:
Question 2.
How does data heterogeneity affect FL collaboration and market competition?
To answer Question 2, we solve the equilibrium of the two-period game and conduct numerical experiments on three public datasets under various levels of data heterogeneity. Notice that the decision-making of the incumbent’s pricing in period 1 presents challenges due to its temporal impacts. That is, it not only influences user decisions in period 1, but also affects the decisions of both companies regarding FL collaboration (with heterogeneous data) and price competition, as well as user decisions in period 2. We will show that this interdependence makes the equilibrium analysis a challenging non-concave problem.
Our key contributions are summarized as follows:
-
•
To our best knowledge, this is the first work to study FL coopetition from a temporal market entry perspective. We formulate a generic two-period model that accommodates heterogeneity including companies’ data distributions and quantities as well as users’ service preferences. Our model is also orthogonal to any FL algorithms.
-
•
We provide game-theoretical solutions to the two-period model. The analysis involves solving a non-concave problem. To tackle this challenge, we decompose the problem into several manageable concave sub-problems and further develop an algorithm that achieves the global optimum.
-
•
We conduct numerical experiments on three public datasets and show two interesting results. First, even under highly heterogeneous data, FL training improves model performance (compared to local learning). However, companies may avoid collaborating in the presence of competition, as FL collaboration also benefits the competitor. Second, data heterogeneity can incentivize the incumbent to limit market penetration in period 1 and promote price competition in period 2.
1.1 Related Work
Heterogeneous FL. Data heterogeneity, also commonly referred to as non-IID data,111Non-IID means not identically and independently distributed. is known to cause significant performance loss in FL due to the client drift issue. Many studies have focused on algorithm development to tackle client drift. One commonly used technique is regularization by adding proximal terms to restrain local updates with respect to the global model, e.g., FedProx [16], SCAFFOLD [12], MOON [15], FedUV [31]. Other works have approached the problem using personalization (e.g., [24, 27]) and local learning generality (e.g., [23]).
This paper focuses on how data heterogeneity affects FL coopetition. Our model and analysis are orthogonal to any FL algorithms mentioned above and beyond.
Incentives for cross-silo FL. Our work is related to game theoretical and, in particular, incentive studies for cross-silo FL, e.g., [35, 43, 6, 18, 7]. For example, Tang and Wong [35] proposed an auction-like mechanism to encourage organizations’ FL training participation. Zhang et al. [43] studied how organizations participate in long-term collaboration. However, these studies overlooked the important aspect of market competition.
Only until very recently, a few papers have looked at market competition in cross-silo FL [9, 34, 40, 38]. Huang et al. [9] studied an oligopoly market. Wu and Yu [40] focused on a fully competitive market. Tan [34] developed an algorithm to find stable collaboration structures among companies. Tsoy and Konstantinov [38] studied both the price and quantity competitions in cross-silo FL. However, these studies did not study how data heterogeneity affects competition. More importantly, they looked at a static competition model while we study a dynamic model where the the incumbent and entrant have temporal interactions. The dynamic model renders the problem a challenging non-concave one.
Market competition in economics. Market competition is an extensively studied topic in economics, e.g., see [36, 33] for comprehensive discussions on theories of competition. Most pertaining to our work is the renowned Hotelling model (e.g., [25, 4]), where companies at different spatial locations compete for users. Our model and analysis differ from the conventional Hotelling due to the unique features of data heterogeneity and collaborative training in FL. That is, prior studies considered that each company can independently decide their service qualities to attract users. In cross-silo FL, however, the qualities of companies’ model-based services are dependent on their heterogeneous data distributions and the FL collaboration strategies. This makes our analysis more challenging than and conclusions different from prior literature.
In summary, to our best knowledge, this paper is the first to study FL coopetition using a dynamic market entry model and also considering data heterogeneity.
2 Model
Sec. 2.1 introduces the companies and users. Sec. 2.2 models their two-period game-theoretical interactions.
2.1 Companies and Users
Companies. We consider a two-period interaction with time index . In period , there is an incumbent company who holds a private dataset with size . It trains a machine learning model using and provides model-based services (e.g., disease diagnosis) to users at a price . In period , an entrant company who has a local private dataset with size enters the market.222See Sec. 5 for discussions on how to extend our model and analysis 1) with more than two companies, and 2) across periods. Since both companies and are in the market, they can choose to collaborate via FL to improve the performance of their models and the quality of model-based services. We use to denote the collaboration decision, where means FL collaboration and means no collaboration. More specifically,
-
•
If , both companies train a shared global model using and till convergence. They will use the converged model to generate model-based services.
-
•
If , each company uses its own data to train a local model, based on which services are generated.
We use to denote company ’s quality of service in period . In particular, is a function of that depends on both companies’ decisions on FL collaboration (and data heterogeneity), which we refer to as hereafter.
Besides the potential FL collaboration, both companies compete for the same users at prices . For simplicity, let Next, we introduce how users respond to companies’ model-based services and prices.
Users. The market consists of a large number of users. To model this, we consider a continuum of users and normalize the total mass to be one. Each user decides whether to buy the service, and if so, from which company. Similar to [20], we assume that each user buys at most once, i.e., if a user buys from company in period 1, it will not buy from company or in period 2 due to them offering substitutable services. Let denote user ’s purchasing decision in period , where means no purchasing and means purchasing from company .
A user’s payoff consists of three parts discussed below.
- •
-
•
Second, users have heterogeneous preferences towards companies’ services. This can arise due to the traveling cost or brand loyalty over a particular company [25]. In the context of cross-silo FL, some users may find that a company’s service matches more closely with their individual characteristics (e.g., demographic profiles and personal attributes). To model users’ heterogeneous preferences, we use the renowned Hotelling model [3, 36], in which users are located on a line and companies and are at the ending points and , respectively. The users’ locations follow a distribution with a PDF and a CDF , which are known to both companies due to market research [20, 9]. Here, we model a user’s preference misalignment as the distance to the company where the service is purchased.333The Hotelling model and its variants (e.g., [29]) have been widely used to model user preferences in the economics literature. One can understand such preference misalignment as the dissimilarity between users’ characteristics and the companies’ data distributions.
-
•
Third, a user needs to pay a price for the service.
Next, we define a user ’s payoff as follows:
(1) | ||||
where are positive constants. Without loss of generality, we normalize to . Note that in period 1, only company is in the market, so a user can only choose to buy from or not buy.
2.2 The Two-Period Game
We model the interactions among the two companies and users as a two-period game (see Fig. 2). At the beginning of period 1, company provides service using locally trained model with quality at price . Then, users make purchasing decisions. In period 2, company enters. Both companies decide whether to collaborate via FL , based on which they generate model-based services with quality . Then, they initiate price competition by selling services at prices .
Users’ decision problem. We consider that users are myopic [13, 20]. That is, in period 1, if a user finds purchasing from company is better off than not purchasing, it will purchase without anticipating the potential entry of company and its service in period 2. Hence, each user’s decision problem is as follows.
(2) |
![Refer to caption](x2.png)
Companies’ decision problem. Both companies aim to maximize their own profit. For company , its goal is to maximize the profit obtained in period 2, i.e.,
(3) |
where is an indicator function, meaning if and only if . Here, is the marginal service cost.444Similar to [7], this paper normalizes the FL collaboration cost, in terms of computation and communication, to be zero. Our analysis and conclusions will not change even if we consider a non-zero cost. Hence, company ’s problem is as follows.
(4) |
Unlike users who are myopic, company is assumed to be forward-looking [32].555This is reasonable due to companies usually having more resources and information than individual users when making decisions. That is, it will strategically set the price in period 1, anticipating the reactions of users and company in period 2. Here, we consider that company knows the information about , which can be acquired via market research [20, 9]. In particular, company ’s aims to maximize its two-period profits:
(5) |
(6) |
where is the marginal service cost. Hence, we formulate company ’s problem below.
(7) |
Next, we solve the two-period game.
3 Solving the Two-Period Game
We first solve the user decision in Sec. 3.1. Then, we solve the companies’ period 2 decisions in Sec. 3.2. Sec. 3.3 presents an algorithm to solve company ’s pricing in period 1. The proofs for all technical results are left to Appendices at the end of this paper.
3.1 Users’ Optimal Purchasing in Two Periods
Since users are myopic, we can solve users’ optimal purchasing in the two periods separately.
Lemma 1.
Each user ’s optimal purchasing in period 1 is
(8) |
Lemma 1 shows that a user is more likely to purchase from company if the model-based service has a better quality , or the price is lower, or the preference misalignment is smaller.
(9) | ||||
Lemma 2.
Assume . Each user ’s optimal purchasing in period 2 is given in (9).
The assumption in Lemma 2 is without loss of generality. One can similarly analyze the case where . Importantly, Lemma 2 shows that users’ purchasing in period 2 depends on companies’ FL collaboration and their prices , including company ’s period 1 price . As will be shown, such temporal dependence will render company ’s decision problem challenging.
3.2 Companies’ Decisions in Period 2
In period 2, given in period 1, both companies decide the FL collaboration and prices to maximize profits. We solve the pricing in Sec. 3.2.1 and FL collaboration in Sec. 3.2.2.
3.2.1 Companies’ Pricing in Period 2
We first solve companies’ optimal pricing in period 2, given and . Since both companies’ prices will affect users’ purchasing decisions and hence the company profits, the companies are playing a price competition game, which we model as follows.
Game 1.
We aim to find the Nash equilibrium (NE) of Game 1.
Definition 1.
NE is considered as a stable strategy profile as no company can achieve a higher profit via unilaterally changing its pricing. Notice that an arbitrary choice of can easily render the equilibrium analysis intractable. To facilitate theoretical analysis, we make some minor assumptions on (and ).
Assumption 1.
Users’ preference distribution satisfies: (i) and is continuous. (ii) is increasing in .
Assumption 1 holds for many widely used distributions, e.g., Gaussian, uniform, and gamma distributions. Now, we discuss the equilibrium existence below.
Proposition 1 can be proved by showing that the price competition game is a concave game, and in particular, each organization’s profit is quasi-concave in its price. Refer to the supplementary material where we have developed a best response algorithm to compute the price equilibrium.
Next, we provide a result that establishes the relationship between the optimal pricing and companies’ quality of service.
Corollary 1.
Each company ’s optimal pricing in period 2 is a non-decreasing function in but a non-increasing function in , where .
Corollary 1 can be proved via contradiction. It means that each company will set a higher price if it has a better quality of service, while it will lower the price if its competitor has a better quality.
3.2.2 Companies’ FL Collaboration in Period 2
Now, we solve companies’ optimal FL collaboration in period 2, given in period 1. The companies decide collaboration strategy for FL, anticipating the price equilibrium of Game 1. We model the two companies’ interactions as a collaboration game.
Game 2.
(FL Collaboration Game in Period 2) The FL collaboration game is a tuple , where each company decides its FL collaboration to maximize , where is the NE of Game 1.
We aim to solve Game 2’s NE defined below.
Definition 2.
Next, we characterize the NE in Proposition2.
Proposition 2.
The profile is the NE of Game 2 if and only if , Otherwise, is the NE.
Proposition 2 means that the two companies will collaborate in FL training if and only if both achieves a higher profit than no collaboration. Next, we characterize a somewhat counter-intuitive result.
Theorem 1 shows that even if FL collaboration improves both companies’ quality of service, it may not be the NE. This is because FL brings model performance gain and competition loss at the same time. That is, the shared FL model also improves the competitor’s quality of service. According to Corollary 1, a company needs to set a lower price to attract users, which can lead to a lower profit. We will show in Sec. 4 that FL is the NE only when the model performance gain is significant and outweighs the competition loss.
3.3 Company ’s Pricing in Period 1
We solve company ’s optimal pricing in period 1. In particular, company decides to maximize its total profit in (7), anticipating the equilibria of the price competition game and FL collaboration game.
Note that solving this problem is challenging due to a few reasons. First, company ’s period-1-price affects users’ decisions in both periods 1 and 2 (see (8)-(9)). This in turn will affect companies’ price competition and FL collaboration in period 2, leading to a highly coupled analysis. Second, even if we established equilibrium existence in Propositions 1-2, we still lack closed-form equilibrium solutions, making the characterization of the profit function challenging. Third, it is easy to showcase that company ’s total profit is non-concave in if we use a Gaussian distribution for .
To address this challenge, we develop an algorithm to compute company ’s optimal pricing in period 1 in Algorithm 1. For ease of presentation, we use and to denote the equilibrium calculated on price of Game 1 and Game 2, respectively. The calculation of is based on the a best response algorithm (details in appendix). The calculation of is based on Proposition 2. Note that even if the problem is non-concave, the proposed algorithm can return the global optimal solution.
The key rationale is that even if the problem is non-concave, we can decompose the problem into several concave sub-problems (i.e., sub-problem in lines 2-6, sub-problem in lines 7-11, and sub-problem in lines 12-16). Then it suffices to locate the optimal solutions for each sub-problem and then compare those to achieve the global optimum.
CIFAR10 local 60.81 ± 4.32 55.34 ± 1.82 53.42 ± 5.37 39.23 ± 6.84 43.27 ± 4.03 local 57.56 ± 3.75 54.50 ± 3.58 49.30 ± 7.41 48.17 ± 5.93 33.51 ± 4.95 FedAvg 69.81 ± 2.26 69.01 ± 2.22 66.96 ± 2.77 57.40 ± 9.02 51.89 ± 6.49 CIFAR100 local 19.00 ± 4.28 18.50 ± 2.79 17.37 ± 2.11 17.17 ± 3.06 16.94 ± 1.89 local 17.93 ± 2.78 17.46 ± 2.39 17.12 ± 2.66 18.09 ± 4.49 14.26 ± 1.79 FedAvg 32.80 ± 3.64 31.16 ± 3.46 29.92 ± 3.45 26.58 ± 3.84 21.03 ± 1.63
CIFAR10 local 38.47 ± 9.91 38.63 ± 8.10 39.80 ± 8.08 40.56 ± 8.25 local 48.07 ± 8.99 49.27 ± 2.84 51.84 ± 0.66 53.23 ± 0.77 FedAvg 59.69 ± 9.55 60.66 ± 1.62 62.12 ± 3.63 62.88 ± 5.50 CIFAR100 local 17.44 ± 2.35 17.20 ± 1.61 18.64 ± 3.03 19.85 ± 4.60 local 16.66 ± 2.17 18.30 ± 1.16 21.50 ± 3.84 22.92 ± 4.87 FedAvg 25.40 ± 2.95 26.14 ± 0.41 29.10 ± 1.15 32.08 ± 1.45 HAM10000 local 76.37 ± 1.65 76.28 ± 0.52 75.61 ± 0.87 75.68 ± 1.24 local 73.67 ± 1.87 76.88 ± 1.44 77.99 ± 1.24 78.11 ± 1.29 FedAvg 79.90 ± 0.91 80.50 ± 0.72 80.89 ± 0.99 81.09 ± 1.48
4 Numerical Results
We conduct numerical experiments to gain more useful insights. In Sec. 4.1, we discuss the simulation setup. In Sec. 4.2, we train FL models on three different datasets and report the test accuracy. In Sec. 4.3, we use the accuracy results to compute the solutions to the two-period game.
4.1 Simulation Setup
We train ResNet-18 on CIFAR-10 and HAM10000, as well as train ResNet-50 on CIFAR-100 using FedAvg [22].666Our model is compatible with any FL algorithms, and this paper focuses on FedAvg, which till today, remains one of the state-of-the-art FL algorithms. CIFAR-10 (100) is a balanced dataset on classes with training and test data [14]. HAM10000 is an imbalanced medical dataset on 7 classes with images from four domains, where each domain represents an institution who collected dermoscopic (skin disease) images [37]. We consider that the two companies have heterogeneous data, which are sampled using the Dirichlet distribution with a controlling parameter , where a smaller implies higher data heterogeneity [5]. We study two scenarios:
-
•
Impact of data heterogeneity: On CIFAR-10 and CIFAR-100, we use . For each , we sample data for company and data for company . We do not explore the impact of data heterogeneity on HAM10000 as the dataset itself is highly imbalanced.
-
•
Impact of data quantity: On CIFAR-10 and CIFAR-100, we fix , assign company data, and change company ’s data volume . On HAM10000, we randomly assign company data and company data of size .
The key hyper-parameters are summarized as follows. We use rounds for FL training, where each round consists of local epochs. We use SGD as the optimizer, and choose learning rate and batch size . We further report the results when each company only uses its own data to train a local model. Each experiment is repeated over 3 runs using different random seeds.
4.2 Training Results
Table 1 reports the training results under different levels of data heterogeneity, where “ (E) local” means that company () trains a model using its local data without FL. From this table, we make two observations.
First, on both datasets, FedAvg consistently outperforms local training models across all values of , including the highly heterogeneous case . This suggests the benefit of FL collaboration in improving local model performances. Second, as decreases, there is a general trend of performance decline for FedAvg. This is due to the notorious client drift issue in FL, which has been observed in many distributed learning literature (e.g., [39, 16]). Despite that data heterogeneity hurts FL performance, we will show a counter-intuitive result in Sec. 4.3 that data heterogeneity promotes price competition.
Table 2 reports the accuracy results under different data quantities. We observe that FedAvg again outperforms local training across different data quantities on the three datasets. Also, increasing data volume consistently improves model accuracy across all datasets, underscoring the importance of data quantity in model training.
4.3 Equilibrium Results
Now, we use Tables 1-2 to calculate the equilibrium of the two period game. We consider that companies’ quality of service is an increasing function in the model accuracy. In particular, we use , where is the mean accuracy value from the tables. We further consider that users’ type (preference) is heterogeneous, which follows a uniform distribution on support .777We have also tested Gaussian distributions and results carry over. We choose coefficients and normalize the service costs and to . We use Proposition 2 to calculate the equilibrium FL collaboration, in which we use the best response algorithm [26] to compute the equilibrium of Game 1. We further use Algorithm 1 to compute the optimal period 1 pricing of company .
CIFAR-10 | |||||
---|---|---|---|---|---|
CIFAR-100 |
CIFAR-10 CIFAR-100 HAM10000
![Refer to caption](x3.png)
![Refer to caption](x4.png)
![Refer to caption](x5.png)
![Refer to caption](x6.png)
Optimal FL collaboration. We first investigate the equilibrium FL collaboration and report the results in Tables 3-4, where means collaboration and means no collaboration. We observe that while FL enhances model performance across the three datasets (see Table 1), intriguingly, collaboration is observed only on CIFAR datasets but not on HAM10000. This may seem counter-intuitive at first glance because the improved performance through FL suggests a natural incentive to collaborative behavior. However, it is crucial to note that improved performance alone does not necessitate collaboration in a competitive environment. Recall from Corollary 1 that a company’s price increases in its own model performance but at the same time decreases in its competitor’s model performance. Hence, collaboration is a beneficial strategy only when the performance gains are substantial enough to outweigh the loss from price competition. For instance, CIFAR datasets exhibit significant performance enhancements (e.g., on CIFAR-10 in Table 1), which motivates collaboration, while the less significant improvements in HAM10000 (e.g., in Table 2) are insufficient to motivate the same collaborative effort. We summarize the above observation below.
Observation 1.
FL collaboration is the NE only when the model performance improvement is substantial.
Optimal Pricing. We now investigate how the optimal pricing changes with data heterogeneity and data quantity . The results are reported in Fig. 3. Note that in period 2 the two companies’ optimal pricing are the same due to 1) both companies having the same (global) model, and 2) users’ preference follows a uniform distribution, which is symmetric for both companies.
From Fig. 3(a)-(b), it is a bit surprising to observe that both companies optimal pricing can increase in data heterogeneity (i.e., a smaller ). While the expectation is that higher heterogeneity leads to worse performance and hence users are willingly to pay, leading to smaller prices. However, this is not always the case. The reason is that when data is highly heterogeneous, even if the model performance declines, the companies still obtain a big performance improvement from FL compared to local learning (e.g., see in Table 1). As a result, company sets a high price in period 1 so that no users buy low-quality service in this period. For example, in Fig. 3(a) at , sets and based on Lemma 1, none of the users will purchase from . Instead, both companies attract users to buy high-quality services at higher prices in period 2, which results in higher profits. This observation has an interesting implication, i.e., data heterogeneity does not always prevent but can promote price competition. In particular, the incumbent company does not harvest most users in the starting period but prefers to compete with the entrant company using better model-based services. We summarize the above observations as follows.
Observation 2.
Data heterogeneity can promote price competition between incumbent and entrant companies.
From Fig. 3(c)-(d), we observe different trends of pricing as a function of on the two datasets. The reason is that the optimal FL collaboration decisions are different (refer to Table 4). On CIFAR-100, the companies collaborate via FL and the performance improvement tends to be larger as increases. Hence, company uses a very large price in period 1 so that no users buy in period 1, and instead users will buy higher-quality services in period 2 at a larger price. On HAM10000, however, the companies do not collaborate in FL. As a result, company is inclined to set a smaller price in period 1 so that most users subscribe to in the first period. Then in period 2, the companies participate in more fierce price competition due to a smaller user pool, leading to a smaller price.
5 Discussions
We have provided a first study on FL coopetition using a dynamic two-period model with two companies. The analysis is highly non-trivial with this stylized model involving a non-concave problem. Next, we discuss how to extend our model with more than two companies across multiple time periods.
Extension to multiple companies. Our model can be extended to scenarios with two or more companies. In particular, consider companies where of them coexist in period 1, and an entrant enters in period 2. This can model real-world market conditions where multiple companies often coexist and new entrants periodically disrupt existing equilibriums. In this case, we can similarly analyze the user behavior by comparing the payoffs obtained when purchasing from different companies. For companies’ FL collaboration, we can use the coalitional game theory to find stable FL collaboration structures, e.g., [1, 34]. For companies’ price competitions, prior studies on oligopoly competition [36] can offer theoretical and algorithmic solutions. However, how to optimally set prices in period 1 (which affects period 2 outcomes) remains a challenging but interesting problem to explore in future work.
Extension to multiple time periods. It is possible to extend our model to where there are periods, and in each period a new entrant company enters the market. For user decisions, it suffices to restrict attention in each period and compute the highest payoff achieved among existing companies. However, we note that solving companies’ FL collaboration and price competition over periods in closed-form is generally analytically intractable. One particular challenge is to estimate future entrants and their properties (e.g., data distributions). One possible remedy is to resort to reinforcement learning for sequential decision making, and in particular, multi-armed bandit [30, 8]. More specifically, one could model the agents as companies, the arms as FL collaboration and pricing, and the reward signals as profits achieved from users, which takes into account competitions and model improvement from FL training.
6 Conclusion
This work studied the under-explored problem of FL coopetition (FL collaboration and market competition) using a dynamic two-period model. One challenge pertains to multi-dimensional heterogeneity in terms of companies’ data distributions and quantities, as well as users’ service preferences. Another challenges is associated with solving a non-concave optimization problem. We decomposed the problem into multiple concave sub-problems and managed to characterize the solutions to the two-period game. Theoretical analysis and numerical experiments on three datasets have lead to two implications. First, FL brings both model performance gain and competition loss, and collaboration occurs only when the performance gain outweighs the loss. Second, data heterogeneity can incentivize the incumbent to limit market penetration in period 1 and promote price competition in period 2.
For future work, it is interesting to study how data quality (e.g., label correctness and label sparsity) affects FL coopetition and further develop robust algorithms to enhance performance. It is also interesting to incorporate privacy enhancing techniques, which can be of particular interest to companies, into the coopetition analysis.
7 Appendices
We organize the supplementary materials as follows.
-
•
In Appendix 8, we prove Lemma 1.
-
•
In Appendix 9, we prove Lemma 2.
-
•
In Appendix 10, we prove Proposition 1.
-
•
In Appendix 11, we prove Corollary 1.
-
•
In Appendix 12, we prove Proposition 2.
-
•
In Appendix 13, we prove Theorem 1.
-
•
In Appendix 14, we prove Theorem 2.
-
•
In Appendix 15, we present a best response algorithm to calculate the NE of Game 1.
8 Proof of Lemma 1
Proof.
Consider the payoff function for user in period given by:
At , the user can either choose to purchase from or not purchase.
For purchasing from , the utility is:
For the user to prefer purchasing over not purchasing, we require:
Thus, the condition for user to choose over at is (when we normalize ):
This, we finish the proof for Lemma 1. ∎
9 Proof of Lemma 2
Proof.
Given the assumption , purchasing from is more efficient from a “cost-benefit” perspective. Moreover, a user will buy in period 2 if it does not buy in period 1, i.e.,
For user to choose in period 2, the payoff should be larger than that from not buying or buying from . That is
Rearranging this, should be within:
To choose , should be high, reflecting a strong preference misalignment favoring despite its lower net utility. Similarly, we obtain:
If neither condition for nor is satisfied, user will not purchase, thus choosing .
Thus, we finish the proof. ∎
10 Proof of Proposition 1
Proof.
We need a useful mathematical result to prove Lemma 2. We state it as a lemma below.
Lemma 3.
There exists a Nash equilibrium if
-
1.
The company set is finite.
-
2.
The strategy space is closed, bounded, and convex.
-
3.
The company profit functions are continuous and quasi-concave in their strategies.
One can easily check that Game 1 has a finite company set . Note that even if each company’s strategy is unbounded, we can narrow down the strategy space to , as any leads to a zero profit. In this case, the reduced strategy space for each company is closed, bounded, and convex. It remains to show that each company’s profit function is quasi-concave in . We begin by deriving the decision threshold for a user to choose organization I over E. Given the user utility functions and assuming:
Rearranging the terms gives:
Solving for , we find an indifference point:
The profit function can be written as:
Taking the first derivative with respect to , we get:
Now, taking the second derivative, we find:
Given that , , , we can see . Thus, is concave in .
A similar process can be applied for . Assuming the utility functions dictate user decisions based on:
we can rearrange this inequality to find the cutoff value where users switch preference from I to E:
The profit function can then be expressed as:
First, compute the first derivative:
indicating that as increases, increases, reducing the interval over which is chosen.
Now, compute the second derivative:
Note that and , the terms involving derivatives of indicate a negative value for the second derivative when the interval decreases as increases. Thus, is concave in .
Hence we finish the proof for Proposition 1. ∎
11 Proof of Corollary 1
Proof.
Part 1: Increasing Function of Its Own Quality
Assume for contradiction that as increases, decreases. If increases, this leads to increased user valuation for company ’s product, which increases the demand at any given price level. However, if decreases while increases, the company misses the opportunity to maximize its profit by leveraging the higher perceived value of a higher quality product. This contradicts profit maximization, thus our assumption must be false. Hence, must be an increasing function of .
Part 2: Decreasing Function of Competitor’s Quality
Assume for contradiction that as increases, increases. An increase in enhances the competitor ’s product attractiveness, likely diverting users away from ’s product, especially if also increases. This would lead to a decrease in the demand for ’s product and thus a reduction in its profits. To counterbalance the increase in and maintain competitiveness, rational behavior would dictate that should decrease to retain market share and profit margins. Therefore, our assumption leads to a contradiction with the profit-maximizing behavior expected in competitive markets. Hence, must decrease as increases.
Thus, we conclude that the equilibrium pricing is an increasing function of its own quality and a decreasing function of the competitor’s quality . ∎
12 Proof of Proposition 2
Proof.
The proof of Proposition 2 is immediate given that in a two-company case, if any one of the company does not participate in FL, then FL ceases to occur. Hence, based on Definition 2, we know that the profile is the NE of Game 2 if and only if , ∎
13 Proof of Theorem 1
Proof.
We prove Theorem 1 by studying a concrete scenario using a uniform distribution of users’ preferences. It consists of three steps.
-
1.
Uniform distribution satisfy the assumptions.
-
2.
Use a particular value of and derive the users’ purchasing in period 1.
-
3.
Construct accuracy scenarios that are consistent with Theorem 1.
1. For the uniform distribution, we know that and is continuous:
-
•
-
•
The function is constant over its domain, hence it is continuous.
Further, to show whether is increasing in , we calculate
which increases in . Hence, the uniform distribution satisfies Assumption 1.
2. We consider that so that no users will buy in period 1.
3. Now we construct a scenario where local learning leads to , while FL training leads to . This implies that FL improves both companies’ qualities. Now, consider , and report the equilibrium profit (calculated using best response in Section 8 which according to [25] converges to NE.)
- | ||
---|---|---|
- | ||
- |
From this table, we see that even if participating in FL leads to higher accuracy for both qualities, the profit of both company is lower, resulting in non-participation as equilibrium.
Hence, we complete the proof for Theorem 1. ∎
14 Proof of Theorem 2
We aim to prove the concavity in three sub-problems (corresponding to different regions).
-
1.
Case a:
-
2.
Case b:
-
3.
Case c:
1. We first prove Case a. When , it is easy to show that all users will buy from company . Hence,
which is clearly concave in .
2. Now we prove case b. e analyze the concavity of by examining its components and .
Analysis of : is given by:
where if , and 0 otherwise. This corresponds to a concave function.
Analysis of : depends on linearly as only affects user range in period 2.
Combining the Functions: Since both components are concave and does not depend on , the sum retains concavity with respect to , as the addition of a constant (or concave independent term) to a concave function does not affect its concavity. Hence, is concave in .
3. Now we prove case c. When , no one buys in period 1, i.e., . trivially does not depend on . Hence, is also concave in this range.
Thus, we finish the proof of Theorem 2.
15 Best Response Algorithm
We provide a best response algorithm below to calculate the equilibrium of Game 1.
References
- Donahue and Kleinberg [2021] K. Donahue and J. Kleinberg. Optimality and stability in federated learning: A game-theoretic approach. Advances in Neural Information Processing Systems, 34:1287–1298, 2021.
- Duffy and Hopkins [2005] J. Duffy and E. Hopkins. Learning, information, and sorting in market entry games: theory and evidence. Games and Economic behavior, 51(1):31–62, 2005.
- Hotbllino [1929] H. Hotbllino. Stability in competition. The economic journal, 39(153):41–57, 1929.
- Hotelling [1929] H. Hotelling. Stability in competition. The Economic Journal, 39(153):41–57, 1929. ISSN 00130133, 14680297. URL https://www.jstor.org/stable/2224214.
- Hsu et al. [2019] T.-M. H. Hsu, H. Qi, and M. Brown. Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335, 2019.
- Huang et al. [2022] C. Huang, S. Ke, C. Kamhoua, P. Mohapatra, and X. Liu. Incentivizing data contribution in cross-silo federated learning. arXiv preprint arXiv:2203.03885, 2022.
- Huang et al. [2023a] C. Huang, M. Tang, Q. Ma, J. Huang, and X. Liu. Promoting collaborations in cross-silo federated learning: Challenges and opportunities. IEEE Communications Magazine, 2023a.
- Huang et al. [2023b] C. Huang, H. Yu, J. Huang, and R. Berry. An online inference-aided incentive framework for information elicitation without verification. IEEE Journal on Selected Areas in Communications, 41(4):1167–1185, 2023b.
- Huang et al. [2024] C. Huang, S. Ke, and X. Liu. Duopoly business competition in cross-silo federated learning. IEEE Transactions on Network Science and Engineering, 11(1):340–351, 2024.
- Huang et al. [2021] Y. Huang, L. Chu, Z. Zhou, L. Wang, J. Liu, J. Pei, and Y. Zhang. Personalized cross-silo federated learning on non-iid data. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 7865–7873, 2021.
- Kairouz et al. [2021] P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, et al. Advances and open problems in federated learning. Foundations and trends® in machine learning, 14(1–2):1–210, 2021.
- Karimireddy et al. [2020] S. P. Karimireddy, S. Kale, M. Mohri, S. Reddi, S. Stich, and A. T. Suresh. Scaffold: Stochastic controlled averaging for federated learning. In International conference on machine learning, pages 5132–5143. PMLR, 2020.
- Kremer et al. [2017] M. Kremer, B. Mantin, and A. Ovchinnikov. Dynamic pricing in the presence of myopic and strategic consumers: Theory and experiment. Production and Operations Management, 26(1):116–133, 2017.
- Krizhevsky et al. [2009] A. Krizhevsky, G. Hinton, et al. Learning multiple layers of features from tiny images. 2009.
- Li et al. [2021a] Q. Li, B. He, and D. Song. Model-contrastive federated learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10713–10722, 2021a.
- Li et al. [2020] T. Li, A. K. Sahu, M. Zaheer, M. Sanjabi, A. Talwalkar, and V. Smith. Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems, 2:429–450, 2020.
- Li et al. [2021b] T. Li, S. Hu, A. Beirami, and V. Smith. Ditto: Fair and robust federated learning through personalization. In International conference on machine learning, pages 6357–6368. PMLR, 2021b.
- Li et al. [2023] Y. Li, X. Wang, R. Zeng, M. Yang, K. Li, M. Huang, and S. Dustdar. Varf: An incentive mechanism of cross-silo federated learning in mec. IEEE Internet of Things Journal, 2023.
- Liu et al. [2022] K. Liu, S. Hu, S. Z. Wu, and V. Smith. On privacy and personalization in cross-silo federated learning. Advances in neural information processing systems, 35:5925–5940, 2022.
- Ma et al. [2018] Q. Ma, B. Shou, J. Huang, and T. Başar. Dynamic pricing in the presence of participation-dependent social learning. In Proceedings of the Eighteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, pages 101–110, 2018.
- Marfoq et al. [2020] O. Marfoq, C. Xu, G. Neglia, and R. Vidal. Throughput-optimal topology design for cross-silo federated learning. Advances in Neural Information Processing Systems, 33:19478–19487, 2020.
- McMahan et al. [2017] B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273–1282. PMLR, 2017.
- Mendieta et al. [2022] M. Mendieta, T. Yang, P. Wang, M. Lee, Z. Ding, and C. Chen. Local learning matters: Rethinking data heterogeneity in federated learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8397–8406, 2022.
- Oh et al. [2022] J. Oh, S. Kim, and S.-Y. Yun. Fedbabu: Towards enhanced representation for federated image classification. Proc. ICLR, 2022.
- Osborne and Pitchik [1987] M. J. Osborne and C. Pitchik. Equilibrium in hotelling’s model of spatial competition. Econometrica: Journal of the Econometric Society, pages 911–922, 1987.
- Osborne and Rubinstein [1994] M. J. Osborne and A. Rubinstein. A course in game theory. MIT press, 1994.
- Pillutla et al. [2022] K. Pillutla, K. Malik, A.-R. Mohamed, M. Rabbat, M. Sanjabi, and L. Xiao. Federated learning with partial model personalization. In International Conference on Machine Learning, pages 17716–17758. PMLR, 2022.
- Qin et al. [2023] Z. Qin, S. Deng, M. Zhao, and X. Yan. Fedapen: Personalized cross-silo federated learning with adaptability to statistical heterogeneity. In Proc. ACM SIGKDD, pages 1954–1964, 2023.
- Salop [1979] S. C. Salop. Monopolistic competition with outside goods. The Bell Journal of Economics, pages 141–156, 1979.
- Slivkins et al. [2019] A. Slivkins et al. Introduction to multi-armed bandits. Foundations and Trends® in Machine Learning, 12(1-2):1–286, 2019.
- Son et al. [2024] H. M. Son, M. H. Kim, T.-M. Chung, C. Huang, and X. Liu. Feduv: Uniformity and variance for heterogeneous federated learning. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
- Spann et al. [2015] M. Spann, M. Fischer, and G. J. Tellis. Skimming or penetration? strategic dynamic pricing for new products. Marketing Science, 34(2):235–249, 2015.
- Stigler [1964] G. J. Stigler. A theory of oligopoly. Journal of political Economy, 72(1):44–61, 1964.
- Tan et al. [2024] S. Tan, H. Cheng, X. Wu, H. Yu, T. He, Y. S. Ong, C. Wang, and X. Tao. Fedcompetitors: Harmonious collaboration in federated learning with competing participants. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 15231–15239, 2024.
- Tang and Wong [2021] M. Tang and V. W. Wong. An incentive mechanism for cross-silo federated learning: A public goods perspective. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications, pages 1–10. IEEE, 2021.
- Tirole [1988] J. Tirole. The theory of industrial organization. MIT press, 1988.
- Tschandl et al. [2018] P. Tschandl, C. Rosendahl, and H. Kittler. The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific data, 5(1):1–9, 2018.
- Tsoy and Konstantinov [2024] N. Tsoy and N. Konstantinov. Strategic data sharing between competitors. Advances in Neural Information Processing Systems, 36, 2024.
- Woodworth et al. [2020] B. E. Woodworth, K. K. Patel, and N. Srebro. Minibatch vs local sgd for heterogeneous distributed learning. Advances in Neural Information Processing Systems, 33:6281–6292, 2020.
- Wu and Yu [2022] X. Wu and H. Yu. Mars-fl: Enabling competitors to collaborate in federated learning. IEEE Transactions on Big Data, 2022.
- Ye et al. [2023] M. Ye, X. Fang, B. Du, P. C. Yuen, and D. Tao. Heterogeneous federated learning: State-of-the-art and research challenges. ACM Computing Surveys, 56(3):1–44, 2023.
- Zhang et al. [2020] C. Zhang, S. Li, J. Xia, W. Wang, F. Yan, and Y. Liu. BatchCrypt: Efficient homomorphic encryption for Cross-Silo federated learning. In USENIX annual technical conference, pages 493–506, 2020.
- Zhang et al. [2022] N. Zhang, Q. Ma, and X. Chen. Enabling long-term cooperation in cross-silo federated learning: A repeated game perspective. IEEE Transactions on Mobile Computing, 2022.