Large Reasoning Models

Implementation of F5-TTS in MLX

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

Prune transformer layers

Awesome LLM compression research papers and tools.

An Open Source Toolkit For LLM Distillation

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

Distributed Inference for mlx LLm

A simple and efficient Mamba implementation in pure PyTorch and MLX.

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

Agentless🐱: an agentless approach to automatically solve software development problems

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Plumb a PDF for detailed information about each char, rectangle, line, et cetera — and easily extract text and tables.

An AI agent that writes (actually useful) code for you

LLM101n: Let's build a Storyteller

Replit Desktop App

xLSTM as Generic Vision Backbone

MLX implementation of xLSTM model by Beck et al. (2024)

Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models

Gemma 2B with 10M context length using Infini-attention.

llama3 implementation one matrix multiplication at a time

This is our own implementation of 'Layer Selective Rank Reduction'

This repository contains the experimental PyTorch native float8 training UX

Run GreenBitAI's Quantized LLMs on Apple Devices with MLX

Material for gpu-mode lectures