This repository is a simple PyTorch implementation of Cross-Silo Federated Learning (FL) with Differential Privacy (DP).
The server contains a list of client instances that perform the training on local data. The Federated Averaging (FedAvg) method is used to combine the updated client models in the global model.
Each client applies a DP mechanism locally using Opacus to perturb trained parameters before uploading to the parameter server.

client.py: definition of the FL client class

server.py: definition of the FL server class

model.py: CNN PyTorch model

data.py: definition of data loaders

utils.py: definition of auxiliary functions

exp_FedMNIST.ipynb: notebook, experiments for the MNIST database

exp_FEMNIST.ipynb: notebook, experiments for the FEMMNIST database

exp_FedMed.ipynb: notebook, experiments for the medical database

1. Install requirements with pip install -r requirements.txt
2. Ensure to put training data into the data directory.
3. Run any notebook in the experiments directory

NR_CLIENTS: Number of distributed clients participating in the training process.
NR_TRAINING_ROUNDS: Number of times that the server performs the global model update
based on the weights collected from the local client models.
DATA: Chosen data (MNIST, FEMNIST or MED).
EPOCHS: Number of epochs that each client is trained during one global training round.
LR: Learning rate used for sgd.
BATCH_SIZE: Size of the training batch.

EPSILON: Privacy loss parameter, determining how much noise is added to the computation.
MAX_GRAD_NORM: The maximum L2 norm of per-sample gradients before they are aggregated by the averaging step.
NOISE_MULTIPLIER: Noise multiplier (during the addition of noise).

IS_PRIVATE: Activate privacy.
IS_PARALLEL: Activate parallelization during clients training.
DEVICE: TORCH device.
VERBOSE: Verbose parameter (server, client, all or other).