Skip to content

๐Ÿƒโ€โ™€๏ธ A curated list about human motion capture, analysis and synthesis.

Notifications You must be signed in to change notification settings

derikon/awesome-human-motion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

20 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Awesome Human Motion Awesome

๐Ÿƒโ€โ™€๏ธ A curated list about human motion capture, analysis and synthesis.

Contents

Introduction

Human Models

  • SMPL - SMPL is a realistic 3D model of the human body that is based on skinning and blend shapes and is learned from thousands of 3D body scans.
  • MakeHuman - MakeHuman is an open source (AGPL3) tool designed to simplify the creation of virtual humans using a Graphical User Interface, also commonly referred to as a GUI.

Datasets

  • Human 3.6M - Large Scale Datasets and Predictive Methodsfor 3D Human Sensing in Natural Environments
  • SURREAL - Learning from Synthetic Humans, CVPR 2017
  • CMU - Carnegie Mellon University Motion Capture Database
  • Berkley MHAD - [๐Ÿ“ท๐ŸŽฅ๐ŸŽค๐Ÿคพโ€โ™€๏ธโŒš๏ธ๐Ÿคนโ€โ™€๏ธ][๐Ÿ‘จโ€๐Ÿฆฐ๐Ÿ‘ฉ][๐Ÿ‘ง๐Ÿ‘ต] - The Berkeley Multimodal Human Action Database (MHAD) contains 11 actions performed by 7 male and 5 female subjects in the range 23-30 years of age except for one elderly subject.
  • COCO - [๐Ÿ“ท][๐Ÿ‘จโ€๐Ÿฆฐ๐Ÿ‘ฉ][๐Ÿ‘ง๐Ÿ‘ต] - COCO is a large-scale object detection, segmentation, and captioning dataset.
  • HDM05 - HDM05 contains more than three hours of systematically recorded and well-documented motion capture data in the C3D as well as in the ASF/AMC data format.
  • KIT Whole-Body Human Motion Database
  • CGVU Interaction Database - This is the project page for creating a database of interactions between a character and an object/objects.

Description

  • Sensors and Data Types - ๐Ÿ“ท(image), ๐ŸŽฅ(video), ๐ŸŽค(audio), ๐Ÿคพโ€โ™€๏ธ(Motion Capture), โŒš๏ธ(IMU or wearables), ๐Ÿคนโ€โ™€๏ธ(Kinect or similar)
  • Sex - ๐Ÿ‘จโ€๐Ÿฆฐ(male), ๐Ÿ‘ฉ(female)
  • Age - ๐Ÿ‘ง(young), ๐Ÿ‘ต(eldery)

Data Processing

Recording

Data Conversion

  • video to bvh - Convert human motion from video to .bvh.
  • MotionCapturePy - Converts motion capture data from ASF and AMC files to Cartesian numpy arrays in python. Also plots a moving human frame using matplotlib.

Misc

Pose Estimation

Lectures

Papers

Implementations

  • 3Dpose_ssl - 3D Human Pose Machines with Self-supervised Learning.
  • 3dpose_gan - The authors' implementation of Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations.
  • 3d_pose_baseline_pytorch - A simple baseline for 3d human pose estimation in PyTorch.
  • 3d-pose-estimation - VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera.
  • 3D-HourGlass-Network - 3D HourGlass Networks for Human Pose Estimation Through Videos.
  • adversarially_parameterized_optimization - GAN-based 3D human pose estimation.
  • DensePose - A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body
  • VideoPose3D - Efficient 3D human pose estimation in video using 2D keypoint trajectorie.
  • 3d-pose-baseline - A simple baseline for 3d human pose estimation in tensorflow. Presented at ICCV 17.
  • Human Shape and Pose - End-to-end Recovery of Human Shape and Pose - CVPR 2018
  • AlphaPose - Real-Time and Accurate Multi-Person Pose Estimation&Tracking System.

Motion Analysis

Implementations