Starred repositories
zero-shot voice conversion with in context learning
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
Speech To Speech: an effort for an open-sourced and modular GPT4-o
Train transformer language models with reinforcement learning.
Reference implementation for DPO (Direct Preference Optimization)
Noise reduction in python using spectral gating (speech, bioacoustics, audio, time-domain signals)
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Open-Sora: Democratizing Efficient Video Production for All
VideoSys: An easy and efficient system for video generation
This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"
Implementation of MagViT2 Tokenizer in Pytorch
OpenMMLab Pose Estimation Toolbox and Benchmark.
《Hello 算法》:动画图解、一键运行的数据结构与算法教程。支持 Python, Java, C++, C, C#, JS, Go, Swift, Rust, Ruby, Kotlin, TS, Dart 代码。简体版和繁体版同步更新,English version ongoing
Official Repo for the Paper: CHATANYTHING: FACETIME CHAT WITH LLM-ENHANCED PERSONAS
Pytorch official implementation for our paper "HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face Generation".
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
[CVPR 2024 Highlight] Official PyTorch implementation of CoDeF: Content Deformation Fields for Temporally Consistent Video Processing
Foundational Models for State-of-the-Art Speech and Text Translation
OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI …
[ICCV'23] Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis
Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!
Out of time: automated lip sync in the wild
MICA - Towards Metrical Reconstruction of Human Faces [ECCV2022]
This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.