#
Starred repositories
Agentic components of the Llama Stack APIs
InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
Aana SDK is a powerful framework for building AI enabled multimodal applications.
A highly efficient library for large scale distributed training
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on tasks like multi-label classification, named entity recognition,…
A working repository for experimental pipelines in distilabel
Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the avai…
Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
awesome synthetic (text) datasets
WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
A simple script for running a mixture of RAG and HF using Ollama and Argilla
A basic script for running an ensemble of TinyLlamas on MLX to annotate an Argilla Dataset
Efficient vector database for hundred millions of embeddings.
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
A framework for Claude Opus to intelligently orchestrate subagents.
Recipes to train reward model for RLHF.
Let's build better datasets, together!
Repository containing the SPIN experiments on the DIBT 10k ranked prompts
A benchmark to evaluate language models on questions I've previously asked them to solve.
A Python native FastAPI server for the Argilla backend.