Stars
Vision Document Retrieval (ViDoRe): Benchmark 👀. Evaluation code for the "ColPali: Efficient Document Retrieval with Vision Language Models" paper.
UniTable: Towards a Unified Table Foundation Model
A lightweight library for portable low-level GPU computation using WebGPU.
SGLang is a fast serving framework for large language models and vision language models.
Tevatron - A flexible toolkit for neural retrieval research and development.
Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and…
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
OCR, layout analysis, reading order, line detection in 90+ languages
Generative Representational Instruction Tuning
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and…
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.
Whisper realtime streaming for long speech-to-text transcription and translation
A New Tamil Large Language Model (LLM) Based on Llama 2
A library for efficient similarity search and clustering of dense vectors.
Train transformer language models with reinforcement learning.
Robust recipes to align language models with human and AI preferences