Papers with MMEA

7 papers
Noise-powered Multi-modal Knowledge Graph Representation Framework (2025.coling-main)

Copied to clipboard

Challenge: Current efforts to integrate MMKG with pretraining are scarce.
Approach: They propose a method that integrates multi-modal entity features into MMKGs using a Transformer-based architecture equipped with modality-level noise masking.
Outcome: The proposed method achieves SOTA performance across ten datasets.
Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment (2023.findings-emnlp)

Copied to clipboard

Challenge: Multi-modal entity alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs).
Approach: They propose a novel MMEA transformer that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance alignment task.
Outcome: The proposed transformer hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task.
MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings.
Approach: They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment.
Outcome: The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment.
CateEA: Enhancing Entity Alignment via Implicit Category Supervision (2025.coling-main)

Copied to clipboard

Challenge: Existing Entity Alignment methods neglect the inherent semantic information of entities, limiting alignment precision and robustness.
Approach: They propose to combine implicit category information into multi-modal representations by generating pseudo-category labels from entity embeddings and integrating them into a multi-task learning framework.
Outcome: Experiments on benchmark datasets show that CateEA outperforms state-of-the-art methods in various settings.
SGMEA: Structure-Guided Multimodal Entity Alignment (2025.coling-main)

Copied to clipboard

Challenge: Existing methods focus on interactions between neighboring entities in the structural modality while neglecting interactions between entities in visual and attribute modalities.
Approach: They propose a structure-guided multimodal entity alignment method which prioritizes structural information from knowledge graphs to enhance the visual and attribute modalities.
Outcome: The proposed method achieves state-of-the-art performance across multiple datasets, validating its effectiveness and superiority in practical applications.
Multi-Modal Entities Matter: Benchmarking Multi-Modal Entity Alignment (2025.coling-main)

Copied to clipboard

Challenge: Existing MMEA datasets consider multi-modal data as attributes of textual entities, neglecting correlations between the multi-modal data.
Approach: They propose a multi-modal entity alignment dataset that models multi-dimensional data as textual entities in the MMKG.
Outcome: The proposed dataset can learn the structural information of entities by considering both intra-modal and cross-modal relations and infer the similarity of different types of entity pairs.
Breaking the Noise Barrier: LLM-Guided Semantic Filtering and Enhancement for Multi-Modal Entity Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multimodal knowledge graphs.
Approach: They propose a novel LLMguided MMEA framework that prioritizes noise reduction before fusion.
Outcome: The proposed framework prioritizes noise reduction before fusion and improves semantics on the noisy FB YG dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations