🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

Personal website using Next.js

Build modern full-stack applications on AWS

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

A Repo For Document AI

Fast and reliable background jobs in Go

Cross-Platform, GPU Accelerated Whisper 🏎️

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

Large Language Model Text Generation Inference

Scale LLM Engine public repository

A language for constraint-guided and efficient LLM programming.

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

🔍 Rails N+1 queries auto-detection with zero false positives / false negatives

A fast and reliable background task processing library for Python 3.

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

A high-throughput and memory-efficient inference and serving engine for LLMs

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

A fast, local neural text to speech system

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

QLoRA: Efficient Finetuning of Quantized LLMs

Interact, analyze and structure massive text, image, embedding, audio and video datasets

🔊 Text-Prompted Generative Audio Model

A school for camelids

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

SoftVC VITS Singing Voice Conversion

Code and documentation to train Stanford's Alpaca models, and generate the data.

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)