LLM training in simple, raw C/CUDA

8-bit CUDA functions for PyTorch

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🤗 AutoTrain Advanced

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

You like pytorch? You like micrograd? You love tinygrad! ❤️

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

Point cloud diffusion for 3D model synthesis

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model, 2022

Ask Me Anything language model prompting

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

Placeholder for the old Stable Diffusion Mac version

Python utilities for running experiments in Azure Machine Learning platform.

Rust native transformers (BERT, DistilBERT) implementations and ready to use models

Vespa - the open big data serving engine