General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for…

vllm for embedding tasks

📋 A list of open LLMs available for commercial use.

A solarized recolor of Obsidian.

Large Language Model Text Generation Inference

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Visualize your multi-stage Dockerfiles

An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)

A simple & elegant experiment tracking framework that integrates persistence logic & best practices directly into Python

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A library to analyze PyTorch traces.

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

A GPU performance profiling tool for PyTorch models

GPUProfiler - Understand your application and workflow resource requirements

A syntax-highlighting pager for git, diff, grep, and blame output

The Lightning Library for LLM Applications.

Maelstrom is a fast Rust and Python test runner that runs every test in its own container. Tests are either run locally or distributed to a clustered job runner.

Completely free, unbelievably stupid wi-fi on long-haul flights

Tegon is an open-source, AI-first alternative to Jira, Linear

🛜 TUI for managing wifi on Linux.

Quickly Iterate on your LLM Application

A curated list of references for MLOps

Python packaging scenarios

The modern replacement for Jupyter Notebooks

📚 Download the full collection of Paul Graham essays in EPUB, PDF & Markdown for easy reading.

A web-based collaborative LaTeX editor

*That* editor.

Python toolkit for quantitative finance

Docmost is an open-source collaborative wiki and documentation software. It is an open-source alternative to Confluence and Notion.