Flops counter for convolutional networks in pytorch framework

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Development repository for the Triton language and compiler

Learning Rate Warmup in PyTorch

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

SAM: Sharpness-Aware Minimization (PyTorch)

Enabling PyTorch on XLA Devices (e.g. Google TPU)

The Julia Programming Language