Paper Reproduction Google SCoRE(Training Language Models to Self-Correct via Reinforcement Learning)

Code for Quiet-STaR

PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838

The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google

SpeechGPT Series: Speech Large Language Models

MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

Foundational Models for State-of-the-Art Speech and Text Translation

Implementation of Google's USM speech model in Pytorch

[AAAI 2024] Code for CTX-vec2wav in UniCATS

SALMONN: Speech Audio Language Music Open Neural Network

AcademiCodec: An Open Source Audio Codec Model for Academic Research

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

Self-Controlled Memory System for LLMs

PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html

FairSeq repo with Apollo optimizer

Code for Cicero, an AI agent that plays the game of Diplomacy with open-domain natural language negotiation.

Pytorch library for fast transformer implementations

Code accompanying the paper Pretraining Language Models with Human Preferences

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.

Fast and memory-efficient exact attention

code of Generalized Delayed Feedback Model with Post-Click Information in Recommender Systems, NeurIPS 2022

10x faster matrix and vector operations