A Dual Branch Network for Emotional Reaction Intensity Estimation

Jun Yu, Jichao Zhu, Wangyuan Zhu, Zhongpeng Cai, Guochen Xie +2 more
3/16/2023
cs.AIcs.HC

No confident code implementation found for this paper.

Abstract

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth Affective Behavior Analysis in-the-wild(ABAW), a dual-branch based multi-output regression model. The spatial attention is used to better extract visual features, and the Mel-Frequency Cepstral Coefficients technology extracts acoustic features, and a method named modality dropout is added to fusion multimodal features. Our method achieves excellent results on the official validation set.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Emotional Reaction Intensity Estimation Based on Multimodal Data

84% match2023

MultiBench: Multiscale Benchmarks for Multimodal Representation Learning

80% match2 repos6.9k2021

RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification

79% match1 repo102023

Interactive Multimodal Fusion with Temporal Modeling

79% match2025

CheXFuse: Guided Differential Joint Attention Fusion for Robust Multimodal Chest X-Ray Classification in Data-Scarce Medical Settings

79% match2026

Before Fusion, Ask What to Keep: Contextual Calibration of Multimodal Signals

79% match2026

Cite this paper

@article{yu2023dual,
  title  = {A Dual Branch Network for Emotional Reaction Intensity Estimation},
  author = {Jun Yu and Jichao Zhu and Wangyuan Zhu and Zhongpeng Cai and Guochen Xie and Renda Li and Gongpeng Zhao},
  year   = {2023},
  eprint = {2303.09210},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.09210v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.09210.svg)](https://codeofpaper.com/paper/2303.09210)

Discussion