Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.

ldd as a tree

Large Language Model Text Generation Inference

🔭 interactively explore `onnx` networks in your CLI.

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

TrailBlazer enables you to seemlessly move through important project marks as quickly and efficiently as possible to make your workflow blazingly fast ™.

A Zig Cuda wrapper

Obsidian 🤝 Neovim

Vim-fork focused on extensibility and usability

Tile primitives for speedy kernels

An interactive and powerful Git interface for Neovim, inspired by Magit

🚀⭐ Minimalistic, powerful and extremely customizable Zsh prompt

A list of useful geocaching tools

A secure, fast, and adaptable OS based on the seL4 microkernel

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and…

The local version of the backend and UI for the gProfiler agent, featuring advanced flamegraph analysis tools. For the also free cloud version, please see https://profiler.granulate.io

A TUI Git client inspired by Magit

Modular Rust transformer/LLM library using Candle

Cross-platform GUI written in Rust using ADB to debloat non-rooted android devices. Improve your privacy, the security and battery life of your device.

A simple program to bring to Influx your SmartThings data through the SmartThings API. No SmartApp installation needed.

Because Glove80 is awesome

A modern Wine wrapper for macOS built with SwiftUI

Split tokens into word pieces

🦙 Integrating LLMs into structured NLP pipelines

🦀 Find the minimum supported Rust version (MSRV) for your project

finalfusion embeddings in Rust

QMK, forked for ZSA's Oryx Configurator (to safeguard stability)