ynych
Follow
Stars
SGLang is yet another fast serving framework for large language models and vision language models.
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
Open-Sora: Democratizing Efficient Video Production for All
Virtual whiteboard for sketching hand-drawn like diagrams
Simple samples for TensorRT programming
🦜🔗 Build context-aware reasoning applications
A high-throughput and memory-efficient inference and serving engine for LLMs
how to optimize some algorithm in cuda.
how to learn PyTorch and OneFlow
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
ms-swift: Use PEFT or Full-parameter to finetune 300+ LLMs or 50+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
A toolkit to run Ray applications on Kubernetes
[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy
[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale
✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Explorations into some recent techniques surrounding speculative decoding
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
🆓免费的 ChatGPT 镜像网站列表，持续更新。List of free ChatGPT mirror sites, continuously updated.
Awesome AI GPTs, OpenAI GPTs, GPT-4, ChatGPT, GPTs, Prompts, plugins, Prompts leaking