• Introduction
• Features
• Methods Comparison
• Configuration
• Training
• Evaluation
• Inference

PyTorch Knowledge Distillation Framework.

Datasets:

• ImageNet

Sample Model:

• Teacher: ResNet50 (from torchvision)
• Student: ResNet18 (from torchvision)

KD Methods:

• Vanilla KD
• TAKD (Coming Soon)
• CRD (Coming Soon)

Features coming soon:

• Native DDP
• Native AMP

Coming Soon...

Create a configuration file in configs. Sample configuration for ImageNet dataset can be found here. Then edit the fields you think if it is needed. This configuration file is needed for both training and evaluation scripts.

$ python train.py --cfg configs/CONFIG_FILE_NAME.yaml

$ python val.py --cfg configs/CONFIG_FILE_NAME.yaml