Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2

Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

Controllable video and image Generation, SVD, Animate Anyone, ControlNet, ControlNeXt, LoRA

Code and data for "AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks"

ViViD: Video Virtual Try-on using Diffusion Models

Official Pytorch implementation of StreamV2V.

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Consistency Distilled Diff VAE

real time face swap and one-click video deepfake with only a single image

Official inference repo for FLUX.1 models

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

Bring portraits to life!

[CVPR 2024] Tackling the Singularities at the Endpoints of Time Intervals in Diffusion Models

ControlNet++: All-in-one ControlNet for image generations and editing!

Kolors Team

Merge identical files from different torrents in qBittorrent

The project page of Diffutoon

[ECCV 2024 Oral] MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

MotionDirector Training For AnimateDiff. Train a MotionLoRA and run it on any compatible AnimateDiff UI.

VisionLLM Series

Trying to implement https://arxiv.org/abs/2305.08891

Understand Human Behavior to Align True Needs

High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance

Enjoy the magic of Diffusion models!

Lumina-T2X is a unified framework for Text to Any Modality Generation

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

A sketch extractor for anime/illustration.

[SIGGRAPH Asia 2024, Journal Track] ToonCrafter: Generative Cartoon Interpolation