An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention)

Agent framework and applications built upon Qwen>=2.0, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.

A Native-PyTorch Library for LLM Fine-tuning

A series of math-specific large language models of our Qwen2 series.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Experiments on Multi-Head Latent Attention

Train transformer language models with reinforcement learning.

Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients

Tensors and Dynamic neural networks in Python with strong GPU acceleration

OpenMMLab Detection Toolbox and Benchmark

OpenMMLab YOLO series toolbox and benchmark. Implemented RTMDet, YOLOv5, YOLOv6, YOLOv7, YOLOv8,YOLOX, PPYOLOE, etc.

A DETR-style framework for open-vocabulary detection (OVD). CVPR 2023

OpenMMLab's next-generation platform for general 3D object detection.

OpenMMLab Pose Estimation Toolbox and Benchmark.

Module 0 - Fundamentals

This repo contains the official implementation of ECCV 2022 paper "What to Hide from Your Students: Attention-Guided Masked Image Modeling"

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

End-to-End Object Detection with Transformers

Module 1 - Autodifferentiation

Recommendation Algorithm大规模推荐算法库，包含推荐系统经典及最新算法LR、Wide&Deep、DSSM、TDM、MIND、Word2Vec、Bert4Rec、DeepWalk、SSR、AITM，DSIN，SIGN，IPREC、GRU4Rec、Youtube_dnn、NCF、GNN、FM、FFM、DeepFM、DCN、DIN、DIEN、DLRM、MMOE、PLE、ESM…

🧑‍🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cycle…

Unofficial PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners

教程→ https://www.liaoxuefeng.com/wiki/896043488029600 推送请使用UTF-8编码

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Official PyTorch Implementation of Rank & Sort Loss [ICCV2021]