An open-source efficient deep learning framework/compiler, written in python.

Fast and memory-efficient exact attention

🧊 The next generation Package Manager for Kubernetes 📦 Featuring a GUI and a CLI. Glasskube packages are dependency aware, GitOps ready and can get automatic updates via a central public package re…

AI-powered Jupyter Notebook — use local AI to generate and edit code cells, automatically fix errors, and chat with your data

cluster/scheduler health monitoring for GPU jobs on k8s

LLM training in simple, raw C/CUDA

Vision utilities for web interaction agents 👀

Fine-tune LLM agents with online reinforcement learning

This repository contains the results and code for the MLPerf™ Training v3.1 benchmark.

A high-throughput and memory-efficient inference and serving engine for LLMs

Repository for MLCommons Chakra schema and tools

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, and IAM services in public beta.

A natural language interface for computers

Consistency Distilled Diff VAE

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

Turn expensive prompts into cheap fine-tuned models

Fine-tuning and serving LLMs on any cloud

AI-powered key driver analysis tool that pinpoints root cause behind metrics fluctuation in one minute.

WebAssembly dev environment for Envoy Proxy. Iterate on your HTTP/TCP middleware in seconds!

A simple Pure Python/PyTorch performance daemon for training workloads

Inference Llama 2 in one file of pure C

The TypeScript framework for AI development

Profiling tools for distributed training

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

React components to build charts and dashboards

The headless rich text editor framework for web artisans.

A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

Distributed DataFrame for Python designed for the cloud, powered by Rust