Challenge: Named entity recognition (NER) is the task of identifying tokens that belong to a predefined set of classes such as "person" or "location"
Approach: They propose a dataset-creation pipeline that scales the teacher-student paradigm to 91 languages and 25 scripts.
Outcome: The proposed model achieves comparable or improved performance in English, Thai, and Swahili despite being trained on 19x less data than strong baselines.

Similar Papers

DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs.
Approach: They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods.
Outcome: The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains.
MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguation) (2022.findings-naacl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a process of identifying named entities in unstructured texts and classifying them through specific semantic categories.
Approach: They propose a method for automatically producing NER annotations and introduce a manually-annotated test set.
Outcome: The proposed method covers 10 languages, 15 NER categories and 2 textual genres and a manually-annotated test set.
Sources of Transfer in Multilingual Named Entity Recognition (2020.acl-main)

Copied to clipboard

Challenge: naive training of named-entity recognition models using annotated data from multiple languages consistently underperforms monolingual models.
Approach: They propose a polyglot named-entity recognition model where one model is trained using annotated data drawn from multiple languages.
Outcome: The proposed model outperforms models trained on monolingual data despite more training data . the proposed model shares many parameters across languages and fine-tunes them to outperFORM monolingual models.
MultiCoNER: A Large-scale Multilingual Dataset for Complex Named Entity Recognition (2022.coling-1)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a core task in Natural Language Processing.
Approach: They present a large multilingual dataset for Named Entity Recognition that covers 3 domains across 11 languages and multilingual and code-mixing subsets.
Outcome: The proposed dataset is large and multilingual, covering 11 languages and subsets.
MultiCoNER v2: a Large Multilingual dataset for Fine-grained and Noisy Named Entity Recognition (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a core task in Natural Language Processing.
Approach: They present a dataset for fine-grained Named Entity Recognition covering 33 entity classes across 12 languages in monolingual and multilingual settings.
Outcome: The proposed dataset covers 33 entity classes across 12 languages in monolingual and multilingual settings.
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER).
Approach: They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data.
Outcome: The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities.
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition (2025.coling-main)

Copied to clipboard

Challenge: Current Large Language Models struggle with complex entity taxonomies in open domains and lack NER capabilities.
Approach: They propose a dataset to guide LLMs' generalization in Open NER under a universal entity taxonomy.
Outcome: The proposed model outperforms GPT-4 in 3 out-of-domain benchmarks across 15 datasets and 6 languages.
WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (2021.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a key intermediate task in NLP.
Approach: They propose a method which uses knowledge-based approaches and neural models to produce high-quality training corpora for NER.
Outcome: The proposed method improves on standard benchmarks and yields significant improvements up to 6 span-based F1-score points over previous state-of-the-art systems for data creation.
Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark (2024.naacl-long)

Copied to clipboard

Challenge: In named entity recognition, the majority of annotation efforts are centered on English, and cross-lingual transfer performance remains brittle.
Approach: They propose to develop gold-standard named entity recognition benchmarks in many languages using a cross-lingual consistent schema.
Outcome: The proposed benchmarks will be released to the public in 2022 . they will provide baselines on in-language and cross-lingual learning settings.
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them .
Approach: They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition .
Outcome: The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations