Official code for ICCV 2023 paper: "Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation".

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

Semantic Image Synthesis with SPADE

Code for "Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose" (Arxiv 2020) and "Predicting Personalized Head Movement From Short Video and Speech Signal" (TMM 2022)

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code

GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

code for paper "Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion" in the conference of IJCAI 2021

VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior

Official repository for Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

[ECCV'24] TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting

💬 An extensive collection of exceptional resources dedicated to the captivating world of talking face synthesis! ⭐ If you find this repo useful, please give it a star! 🤩

Pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing"

PantoMatrix: Co-Speech Talking Head and Gestures Generation

Real time streaming talking head

Official repo for "GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians"

blame the function that changes something

Fast and memory-efficient exact attention

LGM stylization

Official implementation of "Perturbed-Attention Guidance"

[ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

Bring your portraits to life with stunning animations!

head pose estimation

LivePortrait is an advanced deep learning-based system for animating portrait images. It uses a two-stage training process to create realistic and controllable animations from static portrait images.

ControlNet++: All-in-one ControlNet for image generations and editing!