This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!

TorchEEG is a library built on PyTorch for EEG signal analysis.

[IJCAI-24] Spatial-Temporal-Decoupled Masked Pre-training for Spatiotemporal Forecasting

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

📚 A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application

[ICLR 2024 spotlight] Official implementation of "InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior".

[ICML2024] Unified Training of Universal Time Series Forecasting Transformers

[ICLR 2024] M/EEG-based image decoding with contrastive learning. i. Propose a contrastive learning framework to align image and eeg. ii. Resolving brain activity for biological plausibility.

Kolmogorov Arnold Networks

Decode Neural signal as Speech

[ICLR 2024] Official Implementation of "Diffusion-TS: Interpretable Diffusion for General Time Series Generation"

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

Keras implement of Finite Scalar Quantization

ICLR 2024 spotlight

Mamba SSM architecture

A web GUI client of Project V which supports VMess, VLESS, SS, SSR, Trojan, Tuic and Juicity protocols. 🚀

PyTorch implementation of VQ-VAE + WaveNet by [Chorowski et al., 2019] and VQ-VAE on speech signals by [van den Oord et al., 2017]

Code for the paper "Jukebox: A Generative Model for Music"

a simplified version of wav2vec(1.0, vq, 2.0) in fairseq

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

Vector Quantized VAEs - PyTorch Implementation

code for AAAI2022 paper "Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classification"

Unsupervised Feature Learning via Non-parametric Instance Discrimination