Tracking Any Point (TAP)

Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

Robot bimanual manipulation / dual-arm manipulation

[ICRA 2023] A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Clutter

This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and follow me if you like what you see🤩.

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

world modeling challenge for humanoid robots

Code for paper "Patch-Level Training for Large Language Models"

SAM with text prompt

[RSS 2024] Code for "Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals" for CALVIN experiments with pre-trained weights

[Embodied-AI-Survey-2024] Paper list and projects for Embodied AI

Official implementation for paper "EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning".

Latest Advances on Embodied Multimodal LLMs (or Vison-Language-Action Models).

HaMeR: Reconstructing Hands in 3D with Transformers

CleanDiffuser: An Easy-to-use Modularized Library for Diffusion Models in Decision Making

OpenVLA: An open-source vision-language-action model for robotic manipulation.

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, m…

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

Official repository of Learning to Act from Actionless Videos through Dense Correspondences.

PointMamba: A Simple State Space Model for Point Cloud Analysis

A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

Latte: Latent Diffusion Transformer for Video Generation.

MiniSora: A community aims to explore the implementation path and future development direction of Sora.

minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora

Fast Diffusion Models with Transformers