Lists (1)
Stars
Master the command line, in one page
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
AirLLM 70B inference with single 4GB GPU
Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.
An open-source cross-platform alternative to AirDrop
Simulation framework for accelerating research in Private Federated Learning
FEDn: An enterprise-ready federated learning framework. This repository contains the Python framework, CLI and API.
OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production 📈. Supports 20+ monitoring integrations like OpenAI & La…
On-device AI across mobile, embedded and edge for PyTorch
Free and source-available fair-code licensed workflow automation tool. Easily automate tasks across different services.
A vector search SQLite extension that runs anywhere!
Lightning-fast serving engine for AI models. Flexible. Easy. Enterprise-scale.
A list of Free Software network services and web applications which can be hosted on your own servers
Experimental Python bindings for Couchbase Lite
High-quality QR Code generator library in Java, TypeScript/JavaScript, Python, Rust, C++, C.
On-device Inference of Diffusion Models for Apple Silicon
Letta (fka MemGPT) is a framework for creating stateful LLM services.
Examples for building and running LLM services and applications locally with Podman
A high-throughput and memory-efficient inference and serving engine for LLMs
📚 Freely available programming books
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…
Crime Investigation - Explore connections in crime data using the POLE - Person, Object, Location, Event - model in a public dataset from Manchester, U.K.
fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚