Progressively Modality Freezing for Multi-Modal Entity Alignment

Yani Huang, Xuefeng Zhang, Richong Zhang, Junfan Chen, Jaein Kim
7/23/2024
cs.CL

Official code: ninibymilk/PMF-MMEA (19 stars, MIT, last commit 2025-04-10).

Abstract

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to alignment and modal inconsistencies is overlooked, which are caused by inherent differences in multi-modal features. To address these challenges, we propose a novel strategy of progressive modality freezing, called PMF, that focuses on alignmentrelevant features and enhances multi-modal feature fusion. Notably, our approach introduces a pioneering cross-modal association loss to foster modal consistency. Empirical evaluations across nine datasets confirm PMF's superiority, demonstrating stateof-the-art performance and the rationale for freezing modalities. Our code is available at https://github.com/ninibymilk/PMF-MMEA.

View on arXivView PDF

Code Implementations(1)

MIT

[ACL2024] Progressively Modality Freezing for Multi-Modal Entity Alignment

190Shell, PythonJun 3, 20241 years agoMIT
entity-alignmentknowledge-graphmultimodal-deep-learningnlp-machine-learning

Similar Papers

Cite this paper

@article{huang2024progressively,
  title  = {Progressively Modality Freezing for Multi-Modal Entity Alignment},
  author = {Yani Huang and Xuefeng Zhang and Richong Zhang and Junfan Chen and Jaein Kim},
  year   = {2024},
  eprint = {2407.16168},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.16168v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.16168.svg)](https://codeofpaper.com/paper/2407.16168)

Discussion