High-resolution models for human tasks.

Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

Official inference repo for FLUX.1 models

Bring portraits to life!

[ECCV 2024] Official implementation of the paper "X-Pose: Detecting Any Keypoints"

Stable Video Diffusion Training Code and Extensions.

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

One-click Face Swapper and Restoration powered by insightface 🔥

[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

The official GitHub page for the survey paper "A Survey of Large Language Models".

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts…

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

✨✨Latest Advances on Multimodal Large Language Models

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

Foundational model for human-like, expressive TTS

GPT-style network for phonemization with durations of text

リアルタイムボイスチェンジャー Realtime Voice Changer

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

Generative models for conditional audio generation

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Flexible Python configuration system. The last one you will ever need.

Zero-shot multimodal punctuation insertion and truecasing using Whisper

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audi…

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.