Scaling Diffusion Transformers with Mixture of Experts

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

CUBE is a benchmark to evaluate the Cultural Competence of T2I models

Recursive Visual Programming

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

Video Diffusion Alignment via Reward Gradients. We improve a variety of video diffusion models such as VideoCrafter, OpenSora, ModelScope and StableVideoDiffusion by finetuning them using various r…

[ECCV 2024] Powerful and Flexible: Personalized Text-to-Image Generation via Reinforcement Learning

This repository is related to 'Intriguing Properties of Hyperbolic Embeddings in Vision-Language Models', published at TMLR (2024), https://openreview.net/pdf?id=P5D2gfi4Gg

Understand Human Behavior to Align True Needs

Vico: Compositional Video Generation as Flow Equalization

Reward Guided Latent Consistency Distillation

Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision

[WIP] Layer Diffusion for WebUI (via Forge)

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Kolors Team

《动手学大模型Dive into LLMs》系列编程实践教程

[ECCV 2024] Official PyTorch implement of paper "ParCo: Part-Coordinating Text-to-Motion Synthesis": http:https://arxiv.org/abs/2403.18512

Code for the paper DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents, ICML 2024

Awesome List of Consistency Models

code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"

💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.

[ICML 2024] On Discrete Prompt Optimization for Diffusion Models - Google

[ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, Lei Li, Sishuo Chen, Xu Sun, Lu Hou