Multi-modal Expression Recognition with Ensemble Method

Chuanhe Liu, Xinjie Zhang, Xiaolong Liu, Tenggan Zhang, Liyu Meng +3 more
3/17/2023
cs.CV

No confident code implementation found for this paper.

Abstract

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained models are applied to capture more effective emotional information. For these combinations of visual and audio modal features, we utilize two temporal encoders to explore the temporal contextual information in the data. In addition, we employ several ensemble strategies for different experimental settings to obtain the most accurate expression recognition results. Our system achieves the average F1 Score of 0.45774 on the validation set.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning

88% match2023

Cross-modal Prompting for Balanced Incomplete Multi-modal Emotion Recognition

87% match1 repo282025

Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognition

86% match1 repo322024

CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition

86% match1 repo172023

Leveraging Retrieval Augment Approach for Multimodal Emotion Recognition Under Missing Modalities

85% match1 repo22024

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition

85% match1 repo192024

Cite this paper

@article{liu2023multimodal,
  title  = {Multi-modal Expression Recognition with Ensemble Method},
  author = {Chuanhe Liu and Xinjie Zhang and Xiaolong Liu and Tenggan Zhang and Liyu Meng and Yuchen Liu and Yuanyuan Deng and Wenqiang Jiang},
  year   = {2023},
  eprint = {2303.10033},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.10033v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.10033.svg)](https://codeofpaper.com/paper/2303.10033)

Discussion