Challenge: Large language models have advanced information extraction (IE) by enabling zero-shot and few-shot named entity recognition (NER) but their outputs still show persistent and systematic errors.
Approach: They propose a framework that simulates the pilot annotation process and employs LLMs as both annotators and supervisors to refine model disagreements.
Outcome: Using a pilot annotation process, the proposed framework outperforms its supervisor model on 18 benchmarks.

Similar Papers

Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models (2024.naacl-short)

Copied to clipboard

Challenge: Existing studies exploring the performance of large language models on named entity recognition tasks have focused on training task-specific LLMs for NER.
Approach: They propose a training-free self-improving framework that utilizes an unlabeled corpus to stimulate the self-learning ability of LLMs.
Outcome: The proposed framework improves performance on the named entity recognition task by using an unlabeled corpus.
A Herd of Language Models Makes a Better Zero-shot Annotator for Clinical Named Entity Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Clinical named entity recognition (NER) is a core task in clinical NLP.
Approach: They propose a label-modeling method for M**ulti-LLM **A**nnotation using **R**epresentation learning to capture contextual similarity.
Outcome: The proposed method improves the average F1 score by 8.6% over zero-shot baselines while reducing annotation costs.
ZeroNER: Fueling Zero-Shot Named Entity Recognition via Entity Type Descriptions (2025.findings-acl)

Copied to clipboard

Challenge: Existing zero-shot learning methods rely on entity type names for generalization . current solutions require large datasets and prioritize a handful of commonly occurring types .
Approach: They propose a description-driven framework that enhances hard zero-shot NER in low-resource settings.
Outcome: The proposed framework outperforms existing models by up to 16% in the F1 score . it also surpasses baseline models that use type names alone .
Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction (2024.emnlp-main)

Copied to clipboard

Challenge: Existing Relation extraction models require extensive annotated training data, which is costly and labor-intensive to collect.
Approach: They propose a new zero-shot RE task where only relation definitions are provided instead of seen-unseen relation instances.
Outcome: The proposed task significantly improves cost-effective zero-shot performance by large margins.
EvoPrompt: Evolving Prompts for Enhanced Zero-Shot Named Entity Recognition with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a low-resource task that requires supervised learning, but practical scenarios lack annotated data.
Approach: They propose an Evolving Prompts framework that guides the model to better address these issues through continuous prompt refinement.
Outcome: The proposed framework shows consistent performance improvements on four benchmarks.
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have enabled advances in the field of natural language processing . however, their application and potential are still underexplored .
Approach: They evaluate four state-of-the-art instruction-tuned Large Language Models on 13 NLP tasks in English.
Outcome: The evaluated models outperform state-of-the-art models on 13 real-world clinical and biomedical NLP tasks in English.
Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on ICL for Named Entity Recognition (NER) have mainly explored few-shot settings, but the potential of scaling to hundreds of demonstrations has not been thoroughly investigated.
Approach: They evaluate various LLMs across multiple domains using hundreds of ICL examples and then assess the feasibility of using many-shot ICL as a data annotation framework.
Outcome: The proposed framework can be scaled to hundreds of examples and annotate and refining data for low-resource NER tasks.
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models (2021.emnlp-main)

Copied to clipboard

Challenge: Existing language models can be refined for zero-shot commonsense reasoning . however, commons sense reasoning is still an unsolved problem .
Approach: They propose a self-supervised learning approach that refines a pre-trained language model to boost conceptualization.
Outcome: The proposed approach boosts conceptualization by utilizing loss landscape refinement.
SAM-NER: Semantic Archetype Mediation for Zero-Shot Named Entity Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Zero-shot Named Entity Recognition (ZS-NER) remains brittle under domain and schema shifts, where unseen label definitions misalign with a large language model’s intrinsic semantic organization.
Approach: They propose a framework that stabilizes cross-domain transfer through an intermediate, domain-invariant archetype space.
Outcome: Experiments on the CrossNER benchmark show that SAM-NER consistently outperforms strong prior ZS-NER baselines in cross-domain settings.
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them .
Approach: They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition .
Outcome: The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations