The official Python library for the OpenAI API

LLM inference in C/C++

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

An ASGI web server, for Python. 🦄

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Fast and memory-efficient exact attention

Fast inference from large lauguage models via speculative decoding

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

A high-throughput and memory-efficient inference and serving engine for LLMs

The official repo of Qwen-7B (通义千问-7B) chat & pretrained large language model proposed by Alibaba Cloud.

decentralising the Ai Industry, just some language model api's...

ChatGLM-6B：开源双语对话语言模型 | An Open Bilingual Dialogue Language Model

An open-source tool-augmented conversational language model from Fudan University

Live Training for Open-source Big Models

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

Efficient Training (including pre-training and fine-tuning) for Big Models

ChatGPT资料汇总学习，持续更新......

Efficient Inference for Big Models

Common source, scripts and utilities for creating Triton backends.

Model Compression for Big Models

A simple deep learning framework in pure python for purpose of learning in DL

brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" mea…

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

A framework for large scale recommendation algorithms.

人人可用的开源数据可视化分析工具。

Open Source Software Insights - Analysis, Comparison, Trends, Rankings of Open Source Software. Follow us on Twitter: https://twitter.com/ossinsight

A complete CUDA tutorial ranging from first GPU programs to advanced asynchronous methods