Towards Better Entity Linking with Multi-View Enhanced Distillation

Challenge:	Entity linking is a fundamental task in Natural Language Processing (NLP), connecting mentions within unstructured contexts to their corresponding entities in a Knowledge Base (KB).
Approach:	They propose a dual-encoder framework that can efficiently match mentions to two-encoding frameworks by a global-view.
Outcome:	The proposed framework achieves state-of-the-art on several entity linking benchmarks.

Similar Papers

Overview

Challenge

Approach

Outcome

Multi-Grained Knowledge Distillation for Named Entity Recognition (2021.naacl-main)

Copied to clipboard

Xuan Zhou, Xiao Zhang, Chenyang Tao, Junya Chen, Bing Xu, Wei Wang, Jing Xiao

Green & Sustainable NLP

Challenge:	Pre-trained big models have delivered top performance in Seq2seq modeling, but their deployments in real-world applications are often hindered by excessive computations and memory demands.
Approach:	They propose a distillation scheme to efficiently transfer knowledge from big models to their cheaper counterparts.
Outcome:	The proposed scheme maximizes the assimilation of knowledge from the teacher model to the student model.

MuVER: Improving First-Stage Entity Retrieval with Multi-View Entity Representations (2021.emnlp-main)

Copied to clipboard

Xinyin Ma, Yong Jiang, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, Weiming Lu

Representation Learning

Challenge:	Recent advances in entity retrieval ignore the property that meanings of entity mentions diverge in different contexts and are related to various portions of descriptions.
Approach:	They propose a novel approach that constructs multi-view representations for entity descriptions and approximates the optimal view for mentions via a heuristic searching method.
Outcome:	The proposed approach achieves state-of-the-art performance on ZESHEL and improves quality of candidates on three standard Entity Linking datasets.

Scalable Zero-shot Entity Linking with Dense Entity Retrieval (2020.emnlp-main)

Copied to clipboard

Ledell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel, Luke Zettlemoyer

Semantic Text Processing

Challenge:	Existing methods for entity linking use manually curated mention tables and incoming Wikipedia link popularity.
Approach:	They propose a BERT-based entity linking model with a bi-encoder that embeds the mention context and the entity descriptions and then re-ranked the candidate with . they also evaluate the accuracy-speed trade-off inherent to large pre-trained models.
Outcome:	The proposed model is state-of-the-art on recent zero-shot benchmarks and established non-zero-shot evaluations.

Contextual Augmentation for Entity Linking using Large Language Models (2025.coling-main)

Copied to clipboard

Daniel Vollmers, Hamada Zahera, Diego Moussallem, Axel-Cyrille Ngonga Ngomo

Semantic Text Processing

Challenge:	Entity Linking involves detecting and linking entity mentions in natural language texts to a knowledge graph.
Approach:	They propose a fine-tuned model that integrates entity recognition and disambiguation in a unified framework.
Outcome:	The proposed model achieves state-of-the-art on out-of domain datasets and compares with baselines.

Ameli: Enhancing Multimodal Entity Linking with Fine-Grained Attributes (2024.eacl-long)

Copied to clipboard

Barry Yao, Sijia Wang, Yu Chen, Qifan Wang, Minqian Liu, Zhiyang Xu, Licheng Yu, Lifu Huang

Multimodality

Challenge:	Experimental results show that understanding attributes of mentions from text descriptions and visual images plays a vital role in multimodal entity linking.
Approach:	They propose to integrate attributes into multimodal entity linking using a text-image-based knowledge base.
Outcome:	The proposed approach integrates attributes into disambiguation.

Multi-Granularity Structural Knowledge Distillation for Language Model Compression (2022.acl-long)

Copied to clipboard

Chang Liu, Chongyang Tao, Jiazhan Feng, Dongyan Zhao

Semantic Text Processing

Challenge:	Existing methods to transfer knowledge to a small model are not enough to represent the rich semantics of a text.
Approach:	They propose to distill the knowledge to a student hierarchically across layers using a large teacher-student framework.
Outcome:	Experimental results show that the proposed method outperforms distillation methods on GLUE benchmark.

3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding (2024.findings-acl)

Copied to clipboard

Yihao Ding, Lorenzo Vaiani, Caren Han, Jean Lee, Paolo Garza, Josiah Poon, Luca Cagliero

Responsible & Trustworthy NLP

Challenge:	Existing models for visually rich document understanding do not account for the diverse carriers of document versions and their associated noises.
Approach:	They propose a multimodal, multi-task, multiteacher joint-grained knowledge distillation model for visually-rich form document understanding.
Outcome:	The proposed model outperforms baselines on a comprehensive evaluation of public datasets showing it can handle complex structures and content of visually-rich forms.

ThinkLinker: From Low-Rank Interaction to Knowledge-Aware Verification for Multimodal Entity Linking (2026.findings-acl)

Copied to clipboard

Yingyao Ma, Yuanyuan Zhou, Congyu Zhang, Yi Yuan, Jiasong Wu, Lotfi Senhadji, Huazhong Shu

Information Retrieval

Challenge:	Existing methods for multimodal entity linking rely on textual context for disambiguation . textual contextual information alone fails to resolve ambiguity, leading to unreliable disambiguations in weak contexts.
Approach:	They propose a two-stage multimodal entity linking framework called ThinkLinker . they propose fusion mechanism to model joint dependencies among features .
Outcome:	The proposed framework outperforms state-of-the-art models on public benchmark datasets.

Leveraging Entity Information for Cross-Modality Correlation Learning: The Entity-Guided Multimodal Summarization (2024.findings-acl)

Copied to clipboard

Yanghai Zhang, Ye Liu, Shiwei Wu, Kai Zhang, Xukai Liu, Qi Liu, Enhong Chen

Multimodality

Challenge:	Multimodal Summarization with Multimodal Output (MSMO) is a new approach to produce a multimodal summary that integrates both text and relevant images.
Approach:	They propose an Entity-Guided Multimodal Summarization model that integrates both text and relevant images to produce a multimodal summary.
Outcome:	The proposed model integrates text-image and entity-image information and refines image selection through knowledge distillation from a pre-trained vision-language model.

Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)

Copied to clipboard

Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun

Semantic Text Processing

Challenge:	Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks.
Approach:	They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies.
Outcome:	The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%.