Stars
中文Mixtral-8x7B（Chinese-Mixtral-8x7B）
Ongoing research training transformer language models at scale, including: BERT & GPT-2
A modular RL library to fine-tune language models to human preferences
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A curated list of reinforcement learning with human feedback resources (continually updated)
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
Utilities intended for use with Llama models.
Resource-adaptive cluster scheduler for deep learning training.
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
🎉CUDA/C++ 笔记 / 大模型手撕CUDA / 技术博客，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"
how to optimize some algorithm in cuda.
Awesome-LLM: a curated list of Large Language Model
Lucid: A Non-Intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
Implementation of NeurIPS 2021 paper "On Joint Learning for Solving Placement and Routing in Chip Design" & NeurIPS 2022 paper "The Policy-gradient Placement and Generative Routing Neural Networks …
Open-source RAG Framework for building GenAI Second Brains 🧠 Build productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic…
based on C++11 , a mini threadpool , accept variable number of parameters 基于C++11的线程池,简洁且可以带任意多的参数
workspace是基于C++11的轻量级异步执行框架，支持：通用任务异步并发执行、优先级任务调度、自适应动态线程池、高效静态线程池、异常处理机制等。
BS::thread_pool: a fast, lightweight, and easy-to-use C++17 thread pool library
A reading list for deep graph learning acceleration.
A simple, delicate, and modern theme for the static site generator Hexo.
A priority queue implemented in terms of a radix sort