TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues

Hannah VanderHoeven, Brady Bhalla, Ibrahim Khebour, Austin Youngren, Videep Venkatesha +9 more
3/12/2025
cs.CL

No confident code implementation found for this paper.

Abstract

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these multimodal inputs to determine the set of task-relevant propositions that have been raised as the dialogue progresses, and tracks the group's epistemic position and beliefs toward them as the task unfolds. Amid increased interest in AI systems that can mediate collaborations, TRACE represents an important step forward for agents that can engage with multiparty, multimodal discourse.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Common Ground Tracking in Multimodal Dialogue

84% match1 repo42024

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement

80% match2024

Speak or Stay Silent: Context-Aware Turn-Taking in Multi-Party Dialogue

78% match2026

Interaction Dynamics as a Reward Signal for LLMs

77% match2025

Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views

77% match2025

Advancing Audio-Visual Navigation Through Multi-Agent Collaboration in 3D Environments

77% match2025

Cite this paper

@article{vanderhoeven2025trace,
  title  = {TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues},
  author = {Hannah VanderHoeven and Brady Bhalla and Ibrahim Khebour and Austin Youngren and Videep Venkatesha and Mariah Bradford and Jack Fitzgerald and Carlos Mabrey and Jingxuan Tu and Yifan Zhu and Kenneth Lai and Changsoo Jung and James Pustejovsky and Nikhil Krishnaswamy},
  year   = {2025},
  eprint = {2503.09511},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.09511v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.09511.svg)](https://codeofpaper.com/paper/2503.09511)

Discussion