Stars
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
Module, Model, and Tensor Serialization/Deserialization
DSPy: The framework for programming—not prompting—foundation models
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
A minimal GPU design in Verilog to learn how GPUs work from the ground up
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
Helping developers to use AWS Graviton2, Graviton3, and Graviton4 processors which power the 6th, 7th, and 8th generation of Amazon EC2 instances (C6g[d], M6g[d], R6g[d], T4g, X2gd, C6gn, I4g, Im4g…
An annotated implementation of the Transformer paper.
Solve puzzles. Improve your pytorch.
Reverse Engineering: Decompiling Binary Code with Large Language Models
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
Official implementation of Half-Quadratic Quantization (HQQ)
Accessible large language models via k-bit quantization for PyTorch.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
FauxPilot - an open-source alternative to GitHub Copilot server
Run VSCode (codeserver) on Google Colab or Kaggle Notebooks
🌐 The Internet OS! Free, Open-Source, and Self-Hostable.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
Deep Learning Fundamentals -- Code material and exercises
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
A text augmentation tool for named entity recognition.