The fastest way to create an HTML app

Mobile Shell

LLM inference in C/C++

This repo is dedicated to providing open-source tutorials for Large Language Model experimentation.

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

build-once run-anywhere c library

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Structured Text Generation

structured outputs for llms

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Curate better data for LLMs

Wheels for llama-cpp-python compiled with cuBLAS support

Come join the best place on the internet to learn AI skills. Use code "chatbotui" for an extra 20% off.

A new bootable USB solution.

LLM plugin for running models using llama.cpp

Access large language models from the command-line

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Chat language model that can use tools and interpret the results

A guidance compatibility layer for llama-cpp-python

A utility to stream (and record) from a Remarkable2 without hack or third party dependencies

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our c…

A truly Open Source MongoDB alternative

LLM-based code completion engine

nanobind: tiny and efficient C++/Python bindings

Generate python stub files for code completion in IDEs for nanobind modules.

An open source ChatGPT UI.

Let's make sand talk

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset