OpenMMLab Pre-training Toolbox and Benchmark

OpenMMLab Self-Supervised Learning Toolbox and Benchmark

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

ConvMAE: Masked Convolution Meets Masked Autoencoders

SimpleAICV:pytorch training and testing examples.

[ICCV 2023] You Only Look at One Partial Sequence

[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)

PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法

Official Code of Paper "Reversible Column Networks" "RevColv2"

[ECCV 2024] Improving 2D Feature Representations by 3D-Aware Fine-Tuning

Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"

[ICCV 2023] Code base for Revisiting Scene Text Recognition: A Data Perspective

PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection

reproduction of semantic segmentation using masked autoencoder (mae)

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.