Foal-Net:Enhancing Modal Fusion by Alignment and Label Matching for Multimodal Emotion Recognition

[Findings of NAACL 2024] Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation

Explainable Multimodal Emotion Reasoning (EMER) and AffectGPT

[COLING 2024] LLGC: Lorentzian Linear Graph Convolutional Networks for Node Classification

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)

Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances (ACL 2024)

MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (ICLR 2024)

[NeurIPS'23] Emergent Correspondence from Image Diffusion

[Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition

ABAW6 (CVPR-W) We achieved second place in the valence arousal challenge of ABAW6

Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (ACL 2023)

Werewolf-XL Baseline

GiMeFive: Towards Interpretable Facial Emotion Classification 😄😲😭😡🤢😨 (PyTorch Implementation)

We achieved the 2nd and 3rd places in ABAW3 and ABAW5, respectively.

Pytorch implementation for the paper: Multivariate, Multi-frequency and Multimodal: Rethinking Graph Neural Networks for Emotion Recognition in Conversation, CVPR 2023.

Official repository for "eMotions: A Large-Scale Dataset for Emotion Recognition in Short Videos"

Bachelor Thesis - Deep Learning-based Multi-modal Depression Estimation

[CVPR 2023] Official code repository for "How you feelin'? Learning Emotions and Mental States in Movie Scenes". https://arxiv.org/abs/2304.05634

Official source code for the paper: "Reading Between the Frames Multi-Modal Non-Verbal Depression Detection in Videos"

GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"