lixilinx / psgd_torch Star 105 Code Issues Pull requests Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner and more) deep-learning pytorch lie-groups optimization-algorithms stochastic-gradient-descent preconditioner low-rank-approximation second-order-optimization affine-group hessian-vector-product Updated Aug 29, 2024 Python
lixilinx / psgd_tf Star 34 Code Issues Pull requests Tensorflow implementation of preconditioned stochastic gradient descent deep-learning tensorflow lie-groups optimization-algorithms stochastic-gradient-descent preconditioner low-rank-approximation second-order-optimization affine-group hessian-vector-product Updated Nov 23, 2023 Python
hsivan / fosi Star 6 Code Issues Pull requests FOSI library for improving first order optimizers with second order information deep-learning optimizer pytorch lanczos jax second-order-optimization hessian-vector-product Updated Mar 21, 2024 Python