zero-shot voice conversion with in context learning

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Speech To Speech: an effort for an open-sourced and modular GPT4-o

Train transformer language models with reinforcement learning.

Reference implementation for DPO (Direct Preference Optimization)

Noise reduction in python using spectral gating (speech, bioacoustics, audio, time-domain signals)

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Open-Sora: Democratizing Efficient Video Production for All

VideoSys: An easy and efficient system for video generation

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Fast Diffusion Models with Transformers

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Implementation of MagViT2 Tokenizer in Pytorch

OpenMMLab Pose Estimation Toolbox and Benchmark.

《Hello 算法》：动画图解、一键运行的数据结构与算法教程。支持 Python, Java, C++, C, C#, JS, Go, Swift, Rust, Ruby, Kotlin, TS, Dart 代码。简体版和繁体版同步更新，English version ongoing

Mohanson's Blog

Official Repo for the Paper: CHATANYTHING: FACETIME CHAT WITH LLM-ENHANCED PERSONAS

Pytorch official implementation for our paper "HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face Generation".

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

[CVPR 2024 Highlight] Official PyTorch implementation of CoDeF: Content Deformation Fields for Temporally Consistent Video Processing

Tensor library for machine learning

Foundational Models for State-of-the-Art Speech and Text Translation

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI …

[ICCV'23] Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

Out of time: automated lip sync in the wild

MICA - Towards Metrical Reconstruction of Human Faces [ECCV2022]

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.