A Native-PyTorch Library for LLM Fine-tuning

A native PyTorch Library for large model training

Use LitData with MinIO

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

Implementation of Generating Diverse High-Fidelity Images with VQ-VAE-2 in PyTorch

Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793

An awesome repository of local AI tools

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG, Chatbot, Code interpreter) powered by language models. Call…

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

LLM plugin for models hosted on Replicate

Examples using MLX Swift

Swift Package to implement a transformers-like API in Swift

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

This repo is for handling Question Answering, especially for Multi-hop Question Answering

Adding guardrails to large language models.

All the resources you need to get to Senior Engineer and beyond

Fast inference engine for Transformer models

Enforce the output format (JSON Schema, Regex etc) of a language model

This repository contains demos I made with the Transformers library by HuggingFace.

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

Distribute and run LLMs with a single file.

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

Diffusion attentive attribution maps for interpreting Stable Diffusion.

llama3 implementation one matrix multiplication at a time