Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognition

Ran Liu, Fengyu Zhang, Cong Yu, Longjiang Yang, Zhuofan Wen +5 more
3/21/2025
cs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in the real world, compound emotion recognition faces greater issues of uncertainty and modal conflicts. For the Compound Expression (CE) Recognition Challenge,this paper proposes a multimodal emotion recognition method that fuses the features of Vision Transformer (ViT) and Residual Network (ResNet). We conducted experiments on the C-EXPR-DB and MELD datasets. The results show that in scenarios with complex visual and audio cues (such as C-EXPR-DB), the model that fuses the features of ViT and ResNet exhibits superior performance.Our code are avalible on https://github.com/MyGitHub-ax/8th_ABAW

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognition

88% match1 repo322024

Temporal Label Hierachical Network for Compound Emotion Recognition

87% match2024

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition

87% match1 repo192024

Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Better

87% match2024

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

86% match1 repo6172026

Leveraging Retrieval Augment Approach for Multimodal Emotion Recognition Under Missing Modalities

86% match1 repo22024

Cite this paper

@article{liu2025featurebased,
  title  = {Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognition},
  author = {Ran Liu and Fengyu Zhang and Cong Yu and Longjiang Yang and Zhuofan Wen and Siyuan Zhang and Hailiang Yao and Shun Chen and Zheng Lian and Bin Liu},
  year   = {2025},
  eprint = {2503.17453},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.17453v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.17453.svg)](https://codeofpaper.com/paper/2503.17453)

Discussion