Solution for Temporal Sound Localisation Task of ECCV Second Perception Test Challenge 2024

Haowei Gu, Weihao Zhu, Yang Yang
9/29/2024
cs.SDcs.LGeess.AS

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

This report proposes an improved method for the Temporal Sound Localisation (TSL) task, which localizes and classifies the sound events occurring in the video according to a predefined set of sound classes. The champion solution from last year's first competition has explored the TSL by fusing audio and video modalities with the same weight. Considering the TSL task aims to localize sound events, we conduct relevant experiments that demonstrated the superiority of sound features (Section 3). Based on our findings, to enhance audio modality features, we employ various models to extract audio features, such as InterVideo, CaVMAE, and VideoMAE models. Our approach ranks first in the final test with a score of 0.4925.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

The Solution for Temporal Sound Localisation Task of ICCV 1st Perception Test Challenge 2023

91% match2024

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

82% match1 repo682026

Multi-scale Multi-instance Visual Sound Localization and Segmentation

81% match2024

Perception Test 2024: Challenge Summary and a Novel Hour-Long VideoQA Benchmark

81% match2024

UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization

81% match1 repo332024

Adapting to the Unknown: Training-Free Audio-Visual Event Perception with Dynamic Thresholds

80% match1 repo62026

Cite this paper

@article{gu2024solution,
  title  = {Solution for Temporal Sound Localisation Task of ECCV Second Perception Test Challenge 2024},
  author = {Haowei Gu and Weihao Zhu and Yang Yang},
  year   = {2024},
  eprint = {2409.19595},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.19595v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.19595.svg)](https://codeofpaper.com/paper/2409.19595)

Discussion