[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

[CVPR 2024 - Oral, Best Paper Award Candidate] Marigold: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

本人的科研经验

Example code for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 3D keypoints and 3D scans.

[CVPR 2023] CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Character Animation (AnimateAnyone, Face Reenactment)

Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Data (CVPR 24); Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer (ECCV 2024)

Open-Sora: Democratizing Efficient Video Production for All

Summary of publicly available ressources such as code, datasets, and scientific papers for the FLAME 3D head model

Emote Portrait Alive - using ai to reverse engineer code from white paper. (abandoned)

DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models

[CVPR 2024] FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models

Voice Conversion With Just Nearest Neighbors

INTERSPEECH 2023 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023 conference. Explore the latest advances in speech and language processing. Code …

ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal proce…

ML-driven tongue animation (CVPR'22)

This is the official source for our ICCV 2023 paper "EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation"

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

Code Repository for CVPR 2023 Paper "PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360 degree"

Official Code for DragGAN (SIGGRAPH 2023)

ImageBind One Embedding Space to Bind Them All

[TPAMI 2022] GAN Inversion: A Survey