Lists (5)
Starred repositories
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
This is the typescript sdk for the scallop lending platform on SUI network
A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
SGLang is a fast serving framework for large language models and vision language models.
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
ModelScope-Agent: An agent framework connecting models in ModelScope with the world
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
DLRover: An Automatic Distributed Deep Learning System
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
End-to-end stack for WebRTC. SFU media server and SDKs.
kubernetes (k8s) 二进制高可用安装，Binary installation of kubernetes (k8s) --- 开源不易，帮忙点个star，谢谢了🌹
Distributed LLM and StableDiffusion inference for mobile, desktop and server.
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices,…
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
Install and run your own AI agent service
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
Standardized Serverless ML Inference Platform on Kubernetes
