A Native-PyTorch Library for LLM Fine-tuning

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Tensors and Dynamic neural networks in Python with strong GPU acceleration

RCCL Performance Benchmark Tests

NCCL Tests

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A GPU benchmark tool for evaluating GPUs and CPUs on mixed operational intensity kernels (CUDA, OpenCL, HIP, SYCL, OpenMP)

CUDA Templates for Linear Algebra Subroutines

Multi-GPU CUDA stress test

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

Attention is all you need implementation

Implements a LLM similar to Meta's Llama 2 from the ground up in PyTorch, for educational purposes.

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

Mamba SSM architecture

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

The most widely used Python to C compiler

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

Dafny is a verification-aware programming language

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

Integrate cutting-edge LLM technology quickly and easily into your apps

LlamaIndex is a data framework for your LLM applications

Header-only C++/python library for fast approximate nearest neighbors

Library for fast text representation and classification.

Google Research

Benchmarks of approximate nearest neighbor libraries in Python

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

🎓 Path to a free self-taught education in Computer Science!

TensorFlow code and pre-trained models for BERT

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.