Our code is based on the DomainBed, a PyTorch suite containing benchmark datasets and algorithms for domain generalization, as introduced in In Search of Lost Domain Generalization.

This DomainBed is released under the MIT license.

please read main_generalization.py

The currently available algorithms are:

• Empirical Risk Minimization (ERM, Vapnik, 1998)
• Invariant Risk Minimization (IRM, Arjovsky et al., 2019)
• Group Distributionally Robust Optimization (GroupDRO, Sagawa et al., 2020)
• Interdomain Mixup (Mixup, Yan et al., 2020)
• Marginal Transfer Learning (MTL, Blanchard et al., 2011-2020)
• Meta Learning Domain Generalization (MLDG, Li et al., 2017)
• Maximum Mean Discrepancy (MMD, Li et al., 2018)
• Deep CORAL (CORAL, Sun and Saenko, 2016)
• Domain Adversarial Neural Network (DANN, Ganin et al., 2015)
• Conditional Domain Adversarial Neural Network (CDANN, Li et al., 2018)
• Style Agnostic Networks (SagNet, Nam et al., 2020)
• Adaptive Risk Minimization (ARM, Zhang et al., 2020), contributed by @zhangmarvin
• Variance Risk Extrapolation (VREx, Krueger et al., 2020), contributed by @zdhNarsil
• Representation Self-Challenging (RSC, Huang et al., 2020), contributed by @SirRob1997
• Spectral Decoupling (SD, Pezeshki et al., 2020)
• Learning Explanations that are Hard to Vary (AND-Mask, Parascandolo et al., 2020)
• Out-of-Distribution Generalization with Maximal Invariant Predictor (IGA, Koyama et al., 2020)
• Gradient Matching for Domain Generalization (Fish, Shi et al., 2021)
• Self-supervised Contrastive Regularization (SelfReg, Kim et al., 2021)

The implementations use ResNet50 / ResNet18 networks (He et al., 2015)

Example Commands:

clear && CUDA_VISIBLE_DEVICES=3 python main_generalization.py --num-domains 2 --algorithm ERM 

clear && CUDA_VISIBLE_DEVICES=4 python main_generalization.py --num-domains 2 --algorithm GroupDRO 

clear && CUDA_VISIBLE_DEVICES=5 python main_generalization.py --num-domains 2 --algorithm IRM 

clear && CUDA_VISIBLE_DEVICES=6 python main_generalization.py --num-domains 2 --algorithm CORAL 

clear && CUDA_VISIBLE_DEVICES=7 python main_generalization.py --num-domains 2 --algorithm CDANN