Distributed LLM inference for mobile, desktop and server.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

CNCF Jaeger, a Distributed Tracing Platform

Free and Open, Distributed, RESTful Search Engine

⏰ Modern datetime library for Python, written in Rust

Naive XML & JSON Bindings for python

A Python library to extract tabular data from PDFs

The PyTorch Library for LLM Applications.

Collection of useful data science topics along with articles, videos, and code

Efficient Python Tricks and Tools for Data Scientists

Pulumi - Infrastructure as Code in any programming language 🚀

Machine Learning Toolkit for Kubernetes

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

A minimalist yet highly performant, lightweight, multisource, multimodal and local embedding solution, built in rust.

Kubernetes-based, scale-to-zero, request-driven compute

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Create web-based user interfaces with Python. The nice way.

Build GUI for your Python program with JavaScript, HTML, and CSS

Typer, build great CLIs. Easy to code. Based on Python type hints.

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Declaratively deploy your Kubernetes manifests, Kustomize configs, and Charts as Helm releases. Generate all-in-one manifests for use with ArgoCD.

Chat with your Documents(PDF, TXT, DOCX, ODT, PPTX etc), Websites and Youtube Chat too!, CSV files. Uses langchain, Ollama, Groq, Gemini, Streamlit. Llama3 available

A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

AI-based Pull Request Summarizer and Reviewer with Chat Capabilities.

Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs

A modern Python package and dependency manager supporting the latest PEP standards