Simple and extensible hypergradient for PyTorch
First, install torch and its accompanying torchvision appropriately. Then,
pip install hypergrad- conjugate gradient
- Neumann-series approximation
- Nyström method
Implementation of these methods can be found in hypergrad/approximate_ihvp.py
To cite this repository,
@software{hypergrad,
author = {Ryuichiro Hataya},
title = {{hypergrad}},
url = {https://github.com/moskomule/hypergrad},
year = {2023}
}hypergrad is developed as a part of the following research projects:
@inproceedings{hataya2023nystrom,
author = {Ryuichiro Hataya and Makoto Yamada},
title = {{Nystr\"om Method for Accurate and Scalable Implicit Differentiation}},
booktitle = {AISTATS},
year = {2023},
}