Stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
A library for efficient similarity search and clustering of dense vectors.
🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…
WinGet is the Windows Package Manager. This project includes a CLI (Command Line Interface), PowerShell modules, and a COM (Component Object Model) API (Application Programming Interface).
Distribute and run LLMs with a single file.
Self-hosted game stream host for Moonlight.
Development repository for the Triton language and compiler
MySQL Server, the world's most popular open source database, and MySQL Cluster, a real-time, open source transactional database.
AutoHotkey - macro-creation and automation-oriented scripting utility for Windows.
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
一个支持windows/linux/mac的文本编辑器，目标是做中国人自己的编辑器，来自中国。
Transformer related optimization, including BERT, GPT
LostRuins / koboldcpp
Forked from ggerganov/llama.cppRun GGUF models easily with a KoboldAI UI. One File. Zero Install.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
微信机器人底层框架，可接入Gemini、ChatGPT、ChatGLM、讯飞星火、Tigerbot等大模型。WeChat Robot Hook.
Free and open source video editor, based on MLT Framework and KDE Frameworks
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.