FastAPI Best Practices and Conventions we used at our startup

30 days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than100 days, follow your own pace. These videos ma…

A massively parallel, optimal functional runtime in Rust

A massively parallel, high-level programming language

A comprehensive guide to building RAG-based LLM applications for production.

Your buddy in the (L)LM space.

Class materials for a distributed systems lecture series

Open-source AI cookbook

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.

FastAPI wrapper around DSPy

Deploy a complete data stack in just a couple of minutes.

A benchmark to evaluate language models on questions I've previously asked them to solve.

A library for building fast, reliable and evolvable network services.

Installation and usage guide for Triton TRT-LLM

A collection of learning resources for curious software engineers

Poetry plugin for dynamically extracting the package version from a __version__ variable or a Git tag.

Numbers every LLM developer should know

Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Crawl a site to generate knowledge files to create your own custom GPT from a URL

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxiv.org/abs/2312.16171

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

A high-throughput and memory-efficient inference and serving engine for LLMs