SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling

The official GitHub page for the survey paper "Foundation Models for Music: A Survey".

Zero-Shot Speech Editing and Text-to-Speech in the Wild

Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)

Official Implementation of EnCLAP (ICASSP 2024)

Speech, Language, Audio, Music Processing with Large Language Model

ESLTTS dataset

Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation

Instant voice cloning by MIT and MyShell.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audi…

Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture…

TorchCFM: a Conditional Flow Matching library

Inference and training library for high-quality TTS models.

Awesome speech/audio LLMs, representation learning, and codec models

UP-TO-DATE LLM Watermark paper. 🔥🔥🔥

🎛 🔊 A Python library for audio.

music generation with masked transformers!

Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate

Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis

This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples are presented on

ASR text preprocessing utility

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

Audio Codec Speech processing Universal PERformance Benchmark

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music generation et.al.

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

📄 Awesome CV is LaTeX template for your outstanding job application