LLM inference in C/C++

Mirror of CMake upstream repository

Automatic SRE Superpowers within your Kubernetes cluster

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.

LLM training in simple, raw C/CUDA

egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

Intelligence for Kubernetes. World's most promising Kubernetes Visualization Tool for Developer and Platform Engineering teams.

One-click deploy of a Knowledge Graph powered RAG (GraphRAG) in Azure

A modular graph-based Retrieval-Augmented Generation (RAG) system

The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clu…

Little helper to run CNCF's k3s in Docker

Kubescape is an open-source Kubernetes security platform for your IDE, CI/CD pipelines, and clusters. It includes risk analysis, security, compliance, and misconfiguration scanning, saving Kubernet…

👀 A Kubernetes cluster resource sanitizer

Enable Self-Service Operations: Give specific users access to your existing tools, services, and scripts

ipmitool wrapper in Golang

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Use your locally running AI models to assist you in your web browsing

🦄 🎃 👻 Surge 规则集(DOMAIN-SET 和 RULE-SET)，适用于 Surge for iOS 和 Surge for Mac 客户端。

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your d…

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A Cloud Native Batch System (Project under CNCF)

Mellanox Network Operator

Docker implemented in around 100 lines of bash

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

A code-first agent framework for seamlessly planning and executing data analytics tasks.

Bringing Characters to Life with Computer Brains in Unity