Popular repositories Loading

1. exllama exllama Public

   Forked from turboderp/exllama

   A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

   Python 1

2. text-generation-webui text-generation-webui Public

   Forked from oobabooga/text-generation-webui

   A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.

   Python

3. whisper.cpp whisper.cpp Public

   Forked from ggerganov/whisper.cpp

   Port of OpenAI's Whisper model in C/C++

   C

4. exllamav2 exllamav2 Public

   Forked from turboderp/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python

5. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C