| Challenge: | Named Entity Linking (NEL) and relation extraction forms the backbone of Knowledge Base Population tasks. |
| Approach: | They propose a taxonomy to frame common errors and apply it to four well-known Named Entity Linking systems. |
| Outcome: | The proposed taxonomy was applied to four well-known Named Entity Linking systems on three gold standards. |
Similar Papers
Goodwill Hunting: Analyzing and Repurposing Off-the-Shelf Named Entity Linking Systems (2021.naacl-industry)
Copied to clipboard
| Challenge: | Named entity linking (NEL) is a preprocessing step in commercial systems . a small organization or individual could use an off-the-shelf system to accomplish the same objectives . |
| Approach: | They examine how to repurpose off-the-shelf NEL systems to correct sport-related errors. |
| Outcome: | The proposed model can improve sports question-answering accuracy by 25% . the proposed model is based on the best available model . |
Fine-Grained Evaluation for Entity Linking (D19-1)
Copied to clipboard
| Challenge: | Entity Linking (EL) is an Information Extraction task that identifies entity mentions in a text corpus and associates them with an unambiguous identifier in KBs such as Wikipedia, BabelNet, DBpedia, Wikidata and YAGO. |
| Approach: | They propose a fine-grained categorization of different types of entity mentions and links and propose 'fuzzy recall' metric to address the lack of consensus and compare a selection of online EL systems. |
| Outcome: | The proposed task offers a bridge between unstructured text and structured KBs, where EL has applications for semantic search, document classification, relation extraction, and more. |
A Fair and In-Depth Evaluation of Existing End-to-End Entity Linking Systems (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluations of entity linking systems often lack detailed error analysis or a closer look at the results. |
| Approach: | They evaluate existing entity linking systems and propose two new benchmarks . they characterize their strengths and weaknesses and report on reproducibility aspects . |
| Outcome: | The evaluations of existing system have strong biases and artifacts . they characterize their strengths and weaknesses and report on reproducibility aspects . |
Unified Examination of Entity Linking in Absence of Candidate Sets (2024.naacl-short)
Copied to clipboard
| Challenge: | Entity linking systems depend on candidate sets for their performance, but a comprehensive comparative analysis of these systems is lacking. |
| Approach: | They propose a black-box benchmark and a method to evaluate all state-of-the-art entity linking methods. |
| Outcome: | The proposed approach reduces the inference time and memory footprint of some models. |
Scalable graph-based method for individual named entity identification (D19-53)
Copied to clipboard
| Challenge: | Named entity recognition (NED) is a method for identifying named entities within a knowledge base. |
| Approach: | They propose a method for individual identification requiring few annotated data samples. |
| Outcome: | The proposed method is well-motivated for integration in real systems. |
entity-linkings: A Unified Library for Entity Linking (2026.eacl-demo)
Copied to clipboard
| Challenge: | Entity linking (EL) is the task of mapping named entities in text to canonical entries in a knowledge base. |
| Approach: | They propose a unified library for using and developing entity linking systems . a strong emphasis is placed on usability, making it highly extensible . |
| Outcome: | a new library aims to disambiguate named entities in text by mapping them to canonical entries in a knowledge base. |
EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on Entity Linking assumes that the knowledge base is complete and all mentions can be linked. |
| Approach: | They propose a temporally segmented Unknown Entity Discovery and Indexing (EDIN) benchmark where unknown entities have to be integrated into existing entity linking systems. |
| Outcome: | The proposed system detects, clusters, and indexes mentions of unknown entities in context. |
A Domain-Specific Curated Benchmark for Entity and Document-Level Relation Extraction (2026.findings-eacl)
Copied to clipboard
Marco Martinelli, Stefano Marchesin, Vanessa Bonato, Giorgio Di Nunzio, Nicola Ferro, Ornella Irrera, Laura Menotti, Federica Vezzani, Gianmaria Silvello
| Challenge: | Existing biomedical IE benchmarks are narrow in scope and rely heavily on distantly supervised annotations. |
| Approach: | They propose a benchmark for Information Extraction (IE) that annotates entities, concept-level links, and relations manually from PubMed abstracts. |
| Outcome: | The GutBrainIE benchmark is based on more than 1,600 PubMed abstracts, manually annotated by biomedical and terminological experts with fine-grained entities, concept-level links, and relations. |
Systematic Study of Long Tail Phenomena in Entity Linking (C18-1)
Copied to clipboard
| Challenge: | Existing systems for entity linking are based on frequent 'head' cases, while performance drops when moving towards rare 'long tail' entities. |
| Approach: | They propose to use a long tail to investigate the properties of entity linking datasets. |
| Outcome: | The proposed systems overfit to popular/frequent and non-ambiguous cases and find the most difficult cases among the infrequent candidates of ambiguous forms. |
Named Entity Recognition for Entity Linking: What Works and What’s Next (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Entity Linking (EL) systems have achieved impressive results on standard benchmarks thanks to the contextualized representations provided by recent pretrained language models. |
| Approach: | They propose to exploit Named Entity Recognition (NER) to narrow the gap between EL systems trained on high and low amounts of labeled data. |
| Outcome: | The proposed model can be exploited to narrow the gap between EL systems trained on high and low amounts of labeled data. |