Lists (2)
Stars
CUDA integration for Python, plus shiny features
A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
Accessible large language models via k-bit quantization for PyTorch.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
《大模型白盒子构建指南》：一个全手搓的Tiny-Universe
Implementation of popular deep learning networks with TensorRT network definition API
Learning Large Language Model (LLM）(大语言模型学习)
Multilingual Voice Understanding Model
Extensions to YAML syntax for better python interaction
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Open standard for machine learning interoperability
A modern model graph visualizer and debugger
Development repository for the Triton language and compiler
A high-throughput and memory-efficient inference and serving engine for LLMs
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
A computer algebra system written in pure Python
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Design-of-experiment (DOE) generator for science, engineering, and statistics