Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

ImageBind One Embedding Space to Bind Them All

X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

Code and released pre-trained model for our ACL 2022 paper: "DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation"

[ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-Fire mechanism).

[ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection

Recent Advances in Visual Dialog

A benchmark for the task of translation suggestion

Recent Advances in Vision and Language Pre-training (VLP)

End-to-end Speech Translation

Visual Dialog: Light-weight Transformer for Many Inputs (ECCV 2020)

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog

Code for CVPR'19 "Recursive Visual Attention in Visual Dialog"

A implementation of SeqGAN in PyTorch, following the implementation in tensorflow.