ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits

Sethuraman T, Savya Khosla, Onkar Kishor Susladkar, Aditi Tiwari, Seoung Wug Oh +4 more
9/1/2026
cs.CV

No confident code implementation found for this paper.

Abstract

Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Standard datasets mask this limitation by enabling models to exploit static spatial shortcuts. To systematically evaluate this, we introduce XTE-Bench, a diagnostic probe revealing that even large-scale video-language models struggle with basic temporal reasoning, indicating that parameter scaling alone is insufficient to resolve this flaw. To address this, we propose Cross-Modal Temporal Edits (XTE), a self-supervised framework that injects precise temporal supervision. By performing synchronized video-text transformations, XTE generates hard temporal negatives without manual annotation. We instantiate this with ViTAL-X, a lightweight model that equips frozen image-text backbones with temporal awareness while preserving their foundational spatial knowledge. Across six temporal benchmarks, ViTAL-X achieves state-of-the-art performance. Utilizing only 0.4B parameters and 1M training clips, ViTAL-X outperforms 7B-parameter models and surpasses baselines trained on 600x more data. These results demonstrate that targeted, high-quality temporal alignment provides a highly efficient alternative to pure scaling.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{t2026vitalx,
  title  = {ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits},
  author = {Sethuraman T and Savya Khosla and Onkar Kishor Susladkar and Aditi Tiwari and Seoung Wug Oh and Kushal Kafle and Joon-Young Lee and Derek Hoiem and Simon Jenni},
  year   = {2026},
  eprint = {2609.00505},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2609.00505v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2609.00505.svg)](https://codeofpaper.com/paper/2609.00505)

Discussion