Challenge: Current Large Language Models struggle with complex entity taxonomies in open domains and lack NER capabilities.
Approach: They propose a dataset to guide LLMs' generalization in Open NER under a universal entity taxonomy.
Outcome: The proposed model outperforms GPT-4 in 3 out-of-domain benchmarks across 15 datasets and 6 languages.

Similar Papers

OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languages (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets are not consistently formatted and use a variety of chunk encodings (IOB, BIO, etc.), often without documentation.
Approach: They present OpenNER 1.0, a standardized collection of openly-available named entity recognition (NER) datasets.
Outcome: The proposed datasets correct annotation format issues and provide a structure that enables research in multilingual and multi-ontology NER.
MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguation) (2022.findings-naacl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a process of identifying named entities in unstructured texts and classifying them through specific semantic categories.
Approach: They propose a method for automatically producing NER annotations and introduce a manually-annotated test set.
Outcome: The proposed method covers 10 languages, 15 NER categories and 2 textual genres and a manually-annotated test set.
Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark (2024.naacl-long)

Copied to clipboard

Challenge: In named entity recognition, the majority of annotation efforts are centered on English, and cross-lingual transfer performance remains brittle.
Approach: They propose to develop gold-standard named entity recognition benchmarks in many languages using a cross-lingual consistent schema.
Outcome: The proposed benchmarks will be released to the public in 2022 . they will provide baselines on in-language and cross-lingual learning settings.
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs.
Approach: They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods.
Outcome: The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains.
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them .
Approach: They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition .
Outcome: The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs .
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER).
Approach: They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data.
Outcome: The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities.
Towards a Unified Multi-Domain Multilingual Named Entity Recognition Model (2023.eacl-main)

Copied to clipboard

Challenge: Named Entity Recognition is a key task whose performance is sensitive to genre and language.
Approach: They propose a setup for Named Entity Recognition which includes multi-domain and multilingual training and evaluation across 13 domains and 4 languages.
Outcome: The proposed model improves on 13 domains and 4 languages across 13 domain and 4 language domains.
Breaking the Boundaries: A Unified Framework for Chinese Named Entity Recognition Across Text and Speech (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to Named Entity Recognition (NER) tasks are limited by the complexity of the data and the potential connections between tasks.
Approach: They propose a task to break the boundaries between different modal NER tasks by using a unified data format for inputs from different modalités.
Outcome: The proposed task breaks the boundaries between different modal NER tasks and is a unified implementation of them.
GPT-NER: Named Entity Recognition via Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Large-scale language models (LLMs) have shown impressive ability for in-context learning with limited training data.
Approach: They propose a novel sequence labeling task that transforms a sequence labeled as a text-generation task into a self-verification task that LLMs can adapt to.
Outcome: The proposed model performs better on NER than supervised models on a variety of tasks . the proposed model can be easily adapted by LLMs to generate a text sequence .
Pushing the Limits of Low-Resource NER Using LLM Artificial Data Generation (2024.findings-acl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is an important task, but it requires a large amount of labeled data to perform well.
Approach: They propose to use open-source Large Language Models to generate NER data with only a few labeled examples, reducing the cost of human annotations.
Outcome: The proposed method significantly improves the baseline on diverse low-resource NER datasets and can be used to augment datasets with class-imbalance problems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations