[USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Parallelism

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

based on yolo-high-level project (detect\pose\classify\segment\):include yolov5\yolov7\yolov8\ core ,improvement research ,SwintransformV2 and Attention Series. training skills, business customizat…

A minimal, responsive, and feature-rich Jekyll theme for technical writing.

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

State-of-the-art bilingual open-sourced Math reasoning LLMs.

Minimalist, pursuing the ultimate loading speed for a Hexo theme，追求极致加载速度

Imperative-like logging for JAX

You like jax? You like micrograd? You love microjax!

Named Tensors for Legible Deep Learning in JAX

Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，…

Notebooks for the "JAX in Action" book

TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.

A curated list of awesome projects and papers for distributed training or inference

Zero Bubble Pipeline Parallelism

一款支持东方财富A股 自动交易的量化交易框架，支持简单回测

You like pytorch? You like micrograd? You love tinygrad! ❤️

Training and serving large-scale neural networks with auto parallelization.

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies) with DLRM (Deep Learning Recommendation Model)

Code for the paper "Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models"

Open-Source Reproduction/Demo of the LLM Riddles Game