Skip to content
View Vhallo's full-sized avatar
Block or Report

Block or report Vhallo

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Stars

Showing results

LLM Frontend for Power Users.

JavaScript 7,196 2,089 Updated Aug 17, 2024

A fast inference library for running LLMs locally on modern consumer-class GPUs

Python 3,370 251 Updated Aug 16, 2024

An OAI compatible exllamav2 API that's both lightweight and fast

Python 405 58 Updated Aug 16, 2024