Vision Transformer for Action Units Detection

Tu Vu, Van Thong Huynh, Soo Hyung Kim
3/16/2023
cs.CV

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Facial Action Units detection (FAUs) represents a fine-grained classification problem that involves identifying different units on the human face, as defined by the Facial Action Coding System. In this paper, we present a simple yet efficient Vision Transformer-based approach for addressing the task of Action Units (AU) detection in the context of Affective Behavior Analysis in-the-wild (ABAW) competition. We employ the Video Vision Transformer(ViViT) Network to capture the temporal facial change in the video. Besides, to reduce massive size of the Vision Transformers model, we replace the ViViT feature extraction layers with the CNN backbone (Regnet). Our model outperform the baseline model of ABAW 2023 challenge, with a notable 14% difference in result. Furthermore, the achieved results are comparable to those of the top three teams in the previous ABAW 2022 challenge.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Content

86% match2 repos22024

AU R-CNN: Encoding Expert Prior Knowledge into R-CNN for Action Unit Detection

83% match1 repo882018

AU-TTT: Vision Test-Time Training model for Facial Action Unit Detection

83% match2025

Towards Robust DeepFake Detection under Unstable Face Sequences: Adaptive Sparse Graph Embedding with Order-Free Representation and Explicit Laplacian Spectral Prior

82% match2025

MSSTNet: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition

82% match2024

Spatio-Temporal AU Relational Graph Representation Learning For Facial Action Units Detection

82% match1 repo72023

Cite this paper

@article{vu2023vision,
  title  = {Vision Transformer for Action Units Detection},
  author = {Tu Vu and Van Thong Huynh and Soo Hyung Kim},
  year   = {2023},
  eprint = {2303.09917},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.09917v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.09917.svg)](https://codeofpaper.com/paper/2303.09917)

Discussion