Exploring Robust Face-Voice Matching in Multilingual Environments

Jiehui Tang, Xiaofei Wang, Zhen Xiao, Jiayi Liu, Xueliang Liu +1 more
7/29/2024
cs.CV

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

This paper presents Team Xaiofei's innovative approach to exploring Face-Voice Association in Multilingual Environments (FAME) at ACM Multimedia 2024. We focus on the impact of different languages in face-voice matching by building upon Fusion and Orthogonal Projection (FOP), introducing four key components: a dual-branch structure, dynamic sample pair weighting, robust data augmentation, and score polarization strategy. Our dual-branch structure serves as an auxiliary mechanism to better integrate and provide more comprehensive information. We also introduce a dynamic weighting mechanism for various sample pairs to optimize learning. Data augmentation techniques are employed to enhance the model's generalization across diverse conditions. Additionally, score polarization strategy based on age and gender matching confidence clarifies and accentuates the final results. Our methods demonstrate significant effectiveness, achieving an equal error rate (EER) of 20.07 on the V2-EH dataset and 21.76 on the V1-EU dataset.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Contrastive Learning-based Chaining-Cluster for Multilingual Voice-Face Association

84% match1 repo32024

RFOP: Rethinking Fusion and Orthogonal Projection for Face-Voice Association

84% match2025

Face-voice Association in Multilingual Environments (FAME) Challenge 2024 Evaluation Plan

82% match1 repo112024

Linking Faces and Voices Across Languages: Insights from the FAME 2026 Challenge

82% match2025

XM-ALIGN: Unified Cross-Modal Embedding Alignment for Face-Voice Association

81% match1 repo72025

Shared Multi-modal Embedding Space for Face-Voice Association

80% match2025

Cite this paper

@article{tang2024exploring,
  title  = {Exploring Robust Face-Voice Matching in Multilingual Environments},
  author = {Jiehui Tang and Xiaofei Wang and Zhen Xiao and Jiayi Liu and Xueliang Liu and Richang Hong},
  year   = {2024},
  eprint = {2407.19875},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.19875v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.19875.svg)](https://codeofpaper.com/paper/2407.19875)

Discussion