Stars
An extremely fast Python package and project manager, written in Rust.
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.
Y'all thought the dead internet theory wasn't real, but HERE IT IS
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
OCR, layout analysis, reading order, table recognition in 90+ languages
A simple Fast API Backend for Ironclad/rivet
Creating beautiful plots of data maps
Tools for merging pretrained large language models.
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
AirLLM 70B inference with single 4GB GPU
This is a demo-mistral-7b-instruct-v0.1 model starter template from Banana.dev that allows on-demand serverless GPU inference.
PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
A programming framework for agentic AI 🤖
A high-throughput and memory-efficient inference and serving engine for LLMs
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
A natural language interface for computers
Your AI assistant, stt -> llm agent -> tts, full api, can run on raspberry pi
Fast and memory-efficient exact attention
Stable Diffusion web UI
Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and…