MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

JobSet: a k8s native API for distributed ML training and HPC workloads

A curated list of great puzzles

Gemma 2B with 10M context length using Infini-attention.

CUDA checkpoint and restore utility

A list of AI autonomous agents

LLM training in simple, raw C/CUDA

Bitcoin Core integration/staging tree

Cross-platform asynchronous I/O

😎 Awesome lists about all kinds of interesting topics

Universal LLM Deployment Engine with ML Compilation

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformer…

A library for building fast, reliable and evolvable network services.

Open weights LLM from Google DeepMind.

distributed trainer for LLMs

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.

🔥Highlighting the top ML papers every week.

A high-throughput and memory-efficient inference and serving engine for LLMs

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.

A curated list of software and architecture related design patterns.

Curated list of Go design patterns, recipes and idioms

MLX: An array framework for Apple silicon

🚀AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time

基于Python的开源量化交易平台开发框架