✋ 🍴 A repo for processing the raw hand object detections to produce releasable pickles + library for using these

🍷 Support library for the MaskRCNN masks extracted on EPIC-KITCHENS-100

Tame a Wild Camera: In-the-Wild Monocular Camera Calibration

[CVPR 2022] Joint hand motion and interaction hotspots prediction from egocentric videos

Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

Body Transformer: Leveraging Robot Embodiment for Policy Learning

Project Page for Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models

nanoGPT style version of Llama 3.1

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

COYO-700M: Large-scale Image-Text Pair Dataset

Theia: Distilling Diverse Vision Foundation Models for Robot Learning

A high-throughput and memory-efficient inference and serving engine for LLMs

The repo for "Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image" and "Metric3Dv2: A Versatile Monocular Geometric Foundation Model..."

This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!

Scripts to work with LMDB + PyTorch for Imagenet training

本人的科研经验

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

RSS 2024: Expressive Whole-Body Control for Humanoid Robots

An example RLDS dataset builder for X-embodiment dataset conversion.

GRUtopia: Dream General Robots in a City at Scale

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and follow me if you like what you see🤩.