Block or Report
Block or report Vhallo
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abuseStars
Language
Sort by: Recently starred
A fast inference library for running LLMs locally on modern consumer-class GPUs
An OAI compatible exllamav2 API that's both lightweight and fast