Stars
Collection of training data management explorations for large language models
Course Material for the UG Course COMP4901Y
[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
Scalable toolkit for efficient model alignment
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
A high-throughput and memory-efficient inference and serving engine for LLMs
[NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".
DLRover: An Automatic Distributed Deep Learning System
This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.
Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
Open-Sora: Democratizing Efficient Video Production for All
Summarize existing representative LLMs text datasets.
MiniCPM-2B: An end-side LLM outperforming Llama2-13B.
FlagPerf is an open-source software platform for benchmarking AI chips.
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
Serving LLMs on heterogeneous decentralized clusters.
[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
[NeurIPS'23] Speculative Decoding with Big Little Decoder
FlashInfer: Kernel Library for LLM Serving
An open-source framework for training large multimodal models.