MultiMediate'23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions

Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl +7 more
8/16/2023
cs.CVcs.HC

No confident code implementation found for this paper.

Abstract

Automatic analysis of human behaviour is a fundamental prerequisite for the creation of machines that can effectively interact with- and support humans in social interactions. In MultiMediate'23, we address two key human social behaviour analysis tasks for the first time in a controlled challenge: engagement estimation and bodily behaviour recognition in social interactions. This paper describes the MultiMediate'23 challenge and presents novel sets of annotations for both tasks. For engagement estimation we collected novel annotations on the NOvice eXpert Interaction (NOXI) database. For bodily behaviour recognition, we annotated test recordings of the MPIIGroupInteraction corpus with the BBSI annotation scheme. In addition, we present baseline results for both challenge tasks.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluation

85% match2022

Inter-X: Towards Versatile Human-Human Interaction Analysis

83% match2 repos2292023

Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey

81% match2022

Measuring Student Behavioral Engagement using Histogram of Actions

81% match2023

SocialGen: Modeling Multi-Human Social Interaction with Language Models

81% match2025

HOI-M3: Capture Multiple Humans and Objects Interaction within Contextual Environment

80% match1 repo722024

Cite this paper

@article{mller2023multimediate,
  title  = {MultiMediate'23: Engagement Estimation and Bodily Behaviour Recognition in Social Interactions},
  author = {Philipp Müller and Michal Balazia and Tobias Baur and Michael Dietz and Alexander Heimerl and Dominik Schiller and Mohammed Guermal and Dominike Thomas and François Brémond and Jan Alexandersson and Elisabeth André and Andreas Bulling},
  year   = {2023},
  eprint = {2308.08256},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.08256v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.08256.svg)](https://codeofpaper.com/paper/2308.08256)

Discussion