#
Starred repositories
3
stars
written in C++
Clear filter
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
WebAssembly binding for llama.cpp - Enabling in-browser LLM inference