Spatial-temporal Transformer for Affective Behavior Analysis

Peng Zou, Rui Wang, Kehua Wen, Yasi Peng, Xiao Sun
3/19/2023
cs.CV

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

The in-the-wild affective behavior analysis has been an important study. In this paper, we submit our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes V-A Estimation, Facial Expression Classification and AU Detection Sub-challenges. We propose a Transformer Encoder with Multi-Head Attention framework to learn the distribution of both the spatial and temporal features. Besides, there are virious effective data augmentation strategies employed to alleviate the problems of sample imbalance during model training. The results fully demonstrate the effectiveness of our proposed model based on the Aff-Wild2 dataset.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Lightweight Models for Emotional Analysis in Video

81% match1 repo2025

TSkel-Mamba: Temporal Dynamic Modeling via State Space Model for Human Skeleton-based Action Recognition

80% match1 repo12025

TiVaT: A Transformer with a Single Unified Mechanism for Capturing Asynchronous Dependencies in Multivariate Time Series Forecasting

80% match1 repo2024

Multimodal Feature Extraction and Fusion for Emotional Reaction Intensity Estimation and Expression Classification in Videos with Transformers

80% match2023

Entry-Flipped Transformer for Inference and Prediction of Participant Behavior

80% match2022

Self Attention with Temporal Prior: Can We Learn More from Arrow of Time?

80% match2023

Cite this paper

@article{zou2023spatialtemporal,
  title  = {Spatial-temporal Transformer for Affective Behavior Analysis},
  author = {Peng Zou and Rui Wang and Kehua Wen and Yasi Peng and Xiao Sun},
  year   = {2023},
  eprint = {2303.10561},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.10561v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.10561.svg)](https://codeofpaper.com/paper/2303.10561)

Discussion