Stars
Use contrastive learning to train a large language model (LLM) as a retriever
Retrieval and Retrieval-augmented LLMs
Agentic components of the Llama Stack APIs
Multilingual Sentence & Image Embeddings with BERT
Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
MTEB: Massive Text Embedding Benchmark
LLM training code for Databricks foundation models
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Development repository for the Triton language and compiler
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
The Python micro framework for building web applications.
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Minimalistic large language model 3D-parallelism training
Making the food-delivery experience easy for busy folks :)
Examples and guides for using the OpenAI API
Easy and Efficient Quantization for Transformers
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.