🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

The Python programming language

openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

Fast and memory-efficient exact attention

Mamba SSM architecture

Uniform Manifold Approximation and Projection

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.

GTK application to configure gaming devices

A highly efficient implementation of Gaussian Processes in PyTorch

Full description can be found here: https://discuss.huggingface.co/t/pretrain-gpt-neo-for-open-source-github-copilot-model/7678?u=ncoop57

On the Variance of the Adaptive Learning Rate and Beyond

Monte Carlo tree search in JAX

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Reference implementation for DPO (Direct Preference Optimization)

Differentiable convex optimization layers

Pytorch library for fast transformer implementations

A framework for Privacy Preserving Machine Learning

A library for mechanistic interpretability of GPT-style language models

An implementation of Performer, a linear attention-based transformer, in Pytorch

PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

LibKGE - A knowledge graph embedding library for reproducible research

Long Range Arena for Benchmarking Efficient Transformers